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THE APPr.ICATION .OF PICRFORMA WCli MEASURES 
IN A SAMPLE OF ILIjINOIS PUBLIC LTBRARXES 

Introduction and Background 

There have long been coiniDlalnts within the library profession 
that traditional statistics, such as circulation records, do not 
adequately measure a library's Eservice to a community. In an effort 
to help rcmGdy this, the Public Library Association was awarded a 
contract by the U, S. Office of Bducation in 1970 for a study on the 
MeasurGment of Public Library Effectiveness* The study was conducted 
by tlie Bureau of Library and Information Science Research at Rutgers 
Univers ity . 

The Rutgers groui? first conducted a review of the related lit- 
erature and analyzed the then current library statistical reiDorting 
systems. The remainder of the project dealt with the following 
items: (1) the development of criteria which apiDear descriptive of 
the effectiveness of a public library program," (2) the development 
of a methodology for the collection of appropriate criteria data, 

(3) the collection of data in a small number of pilot study libraries, 

(4) the establishment of tentative ranges of performance, (5) the 
testing of the criteria and methodology in a national sample of pub- 
lic libraries (due to a lack of funds, the Rutgers group was not 
able to test the newly developed measures in a full range of public 
libraries however), and (6) the preparation of a "profile" for each 
of the sample libraries. The Bureau of Library and Information 
Science Research issued a final report of the project entitled Per- 
form ance Measures for Public Libraries,! which was published by the _ 
Public Library Association in 1973. 

Following the initial Rutgers project was a study conducted by 
the North Suburban Library System of Illinois. This pilot study 
basically used the same methods of data collection as were used by 
Rutgers, but it tested the methods in a different size range of 
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llhrarios. Rutgors had applied thG m-^ lihodology to a samplG of twcinty 
librariGs with budgets ranging hctv^GGn $100,000 and $3,499,999, v/hil© 
North Suburban tcstcid the measures in twanty-nine librariGs with to- 
tal oi^Gratlng OKpQnr3i turGs ranging from arjproximately $22, 000 to 
$740,000, The North Suburban pilot study thus attempted to test the 
mGthodology on smaller libraries than had previously been used* 

Staff merrODers of the North Suburban Library System held a work- 
shop Geirly in the spring of 1974 to describe the data collection 
tGchniquGS to thGir marrQ^er libraries. They distributed ''user tickets" 
to the member libraries for the colleation of data from their library 
patrons during a three-day period between May 6 and May 12, 

These data wer-e then sent to the University of Illinois Library 
Research Center, which had been funded by an Illinois State Library 
IjSCA grant to analyse the North Suburban pilot study data* (See 
Appendix A for a more detailed report of the North Suburban pilot study,) 

The Library Research Center was also funded by the Illinois State 
Library with LSGA funds for the purpose of testing the data collec- 
tion techniques which had been developed by the staff of the Bureau 
of Library and Information Science Research at Rutgers and which had 
been incorporated into a performance measures manual—Performance 

Measures fo r Public Libraries^ a Procedures Manual for the Coll ection 

2 

and Tabulatio n of Data * 

Meanwhile, a revised version of the Rutgers performance measures 
manual was used in an evaluation of the St* Petersburg/ Florida, 
public libraries,^ The St* Petersburg study was conducted by Ellen 
Altman/ who was one of the authors of the original Rutgers manual. 

In addition to the 1974-75 Illinois project^ a similar study in 
New Jersey was designed to further test the performance measures manual 
developed at Rutgers, The new Rutgers- project was funded by the New 
Jersey State Library* Its major purposes were to implement and test . 
the reliability of the measurement techniques developed during the 
initial PLA/ALA sutdy; to develop additional measures of library 
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^jnirvicQ availabili Uy /in Now JarBoyj l:o implcninnt an Gducational pro-- 
gram basGd upon tho maa.^urGniGn t tools .in ordtar to train Now Jcrsoy 
library pcrsonnGl in data collGction and analysis of library opGra- 
tions; and to invostigata tho fGasibility of incorporating those mea- 
sui'Gs into a state-wide statistical rGx^orting system. 

The research bureau at RutgGrs planned to test their measures in 
a sample of libraries selectcsd to allow the testing of the measures 
in a variety of librariGs, including systems^ small libraries^ and 
libraries in difftarent geographical areas* It was not considered 
essential that their sample be representative of libraries in New 
Jersey. They proiDOsed to first test the performance measures in ap-- 
proximately 25 public libraries ■ with budgets of over $100,000 per year. 
These librad. es were to include area library centers, when possible, 
in order to assure wide geographical spread. Second, they jDroposed 
to select a sami^le of 20--25 libraries with budgets of under $100,000^ 
with special emphasis on libraries with quite small budgets. And 
third, Rutgers planned to include four or five college libraries that 
were used heavily by the public, 

Illinois Project 

The Illinois project was part of the Illinois State Library's 
program of measuremant and evaluation to assist library administrators 
at the local, system, and state level, and its program of research on 
problems common to libraries and library systems to facilitate the 
continued improvement of services at all levels, The project com- 
plemented the work of the Public Library Association's Committee on 
Public Library Goals, Guidelines, and Standards, and the Illinois 
Library Association's Standards Committee, It was conducted by 
Lucille M, Wert, Project Director, and Director of the University of 
Illinois Library Research Center, and four half-time Library Research 
Center staff meirbers-^-^Ronald R, Powell, Research Associate and 
Principal Investigator; Teresa M* Fox, Research Associate; Tillie 



EKLC 



? 




Kriegtar^ Research Associate; and Stophen Von Vogt, RGsearch Assistant. 
The Library Research Center staff WGi:'e advised by a task force con- 
sisting of Galen Rikc/ SpGcialist, RGsearch and Statistics^ Illinois 
State Libraryi Pat Hogan, Information Librarian^ North Suburban Li- 
brary System; Gerald Born^ Executive Secretary^ Public Library 
Association? Hugh Vrooman, Manager, Systems Analysis and Management, 
Illinois State Library; Andrew Stimson/ Senior Consultant for Public 
Library Services, Illinois State Library; and Ruth Gregory, Xii- 
brarian, Waulcegan Public Library, The Research Center staff also 
received valuable assistance from three graduate student assistants-- 
Mitzi Hanno, Gene Wiemers, and Susan Pike. 

Goals and Obi ectives 

The long-grange goal of the Illinois project was to make avail- 
able meaningful information to assist public library administrators, 
library board members, government officials, and interested citizens 
in the evaluation and improvement of their public libraries. 

The important imjnediate ob.jectives of the project were to: (1) 
test the performance measures manual on a representative sample of 
Illinois public libraries, (2) teach a sample of Illinois public 
library personnel and library system personnel the data collection 
teGhniques necessary for using the performance measures manual, (3) 
assist the participating libraries in the analysis of their data, 
and (4) provide each library with a profile presenting its "scores" 
on the major performance measures along with the respective scores 
for other participating libraries in the same budget category. 

In contrast to the Rutgers project, the Illinois study did not 
attempt to develop any additional measures of library service or to 
implement a statewide statistical reporting system* However, its 
primary purpose, the testing of the performance measures manual, was 
essentially the same as the major objective of Rutgers. 
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Ch or a c l;nr iBhlca of iJ. ljino is Librctrlr^s 

The 1973-1974 Illinois public library statistics^ indicaUed 
that a majority of the approximately 532 Illinois public libraries 
wQre quite small and had rather low annual incomes, Fifty--five per- 
cent served populations of less than 5,000 persons; seventy xoercent 
served populations of lees than 10^000, Excluding the city of 
Chicago^ Illinois public libraries served populations ranging between 
250 and 12 7,000 persons. 

Porty^one percent of the libraries had an annual tax income of 
less than $10,000; sixty-^two percent had an annuar tax Income of 
less than $25, 000* The average total operating expenditures and 
average number of volumes held were also rather low for the public 
libraries in Illinois as can be seen in Table 1 and Table 2, 

TABLE 1 



NUMBER AND PERCENT OF ILLINOIS LIBRARIES 
BY TOTAL OPERATING EXPENDITURES 



Total Operating Expe nditures 



Number of 
Libraries 



Percent of 
Libraries 



Less than $10,000 
10, 000^^-19, 999 
20, 000^^49,999 
50,000^-99,999 
100,000^^299,999 
300,000 and over 



197 
96 
84 
62 
65 
28 



18 
16 
12 
12 
5 
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TABI.E 2 

NaMBER AND PKRCENT OP ILLINOIS 
LIBHARIES BY COLLECTION SI^E 



NumlDsr of Volumes Held 


Number of 


PercGnt o: 




LibrariGS 


Libraries 


Less than lOiOOO 


177 


36% 


10, 000— -19, 999 


158 


32 


20,000--39,999 


79 


16 


40, 000— -59,999 


32 


6 


60,000--99,999 


29 


6 


100,000--300, 000 


21 


4 



. The x^iJ^^lic libraries in Illinois are concentrated in the northern 
part of the state. There are approximately 134 public libraries in 
the Chicago area (excluding the Chicago Public Library and its 
branches) , 122 libraries in the remaining part of northern Illinois, 
180 libraries in the central part of the state, and 96 in the southern 
third. All but eleven of the state's public libraries belong to one 
of the state's eighteen public library systems. 

Methodology 

Sainple Design 

As noted earlier, a major objective of- the study was to test the 
Rutgers performance measures manual in all sizes of public libraries 
in Illinois, and for statistical purposes, it was considered impor- 
tant to have significant arici nearly equal nuniers of libraries 
representing the major size ranges. Similar to the Rutgers study, 
it was not considered essential that the libraries included in the 
project be exactly representative of the libraries in Illir :is, and 
it was considered important that the manual be tasted on a signifi- 
cant nuirtoer of small libraries. In contrast to Rutgers, the Illinois 



10 




7 



BamplG was ruioLricUod to public libraries. 

As it v/as moBt pracbical to sGlQct llbrarias on the bosis of 
only onQ "bI^o" vairiable, it was neccsrsary to dGtormine which variablG 
was the most influGntial. ConsGquGntly , it was dGcided to input 
several variables, including total oiDerating rGcoipts, total oiDGrating 
nxpendi tures, XDOpulation served; and volumes held, in a multiplG 
regrGssion computer program to find the variable that was able to 
exi^lain the most variation in each of the other variables. Each of 
the variablGS was, in turn, trcaatGd as the ■'dei^Gndent" variable in a 
multiplG regression design. It was then determined which of the 
remaining variables providGd the best predictor of the "dGpendent'' 
variable (after rGmoving the effects of the other independent 
variables) . It %vas thus found that total operating expenditures 
tended to explain the most variation in the other variables and there- 
fore appeared to be the most revealing "size" variable. 

All of the public libraries in Illinois, excluding the Chicago 
Public Library, were then divided according to their geographical 
region (Chicago area, northern Illinois, central Illinois, and 
southern Illinois) in order to assure that some libraries in all 
areas of the state would have a chance to participate in the study* 
The Chicago area included North Suburban, Suburban, and Du Page 
Library Systems j the northern area included Northern Illinois, River 
Bend, Starved Rock, and Bur Oak Library Systems; the central area 
included V7estern Illinois, Great River, Illinois Valley, Corn Belt, 
Lincoln Trail, and Rolling Prairie Library Systems; and the southern 
area included Lewis and Clark, Cumberland, Kaskaskia, and Shawnee 
Library Systems, Next, the libraries were stratified on total oper- 
ating expenditures within each geographical area. The strata con- 
tained libraries within the following ranges: $0^-9,999, $10,000-^ 
19,999, $20,000^-^49,999, |50, 000—99, 999, |100 , 000— 299 , 999 , and 
$300,000 and over (see Table 1 for the statewide distribution of 
libraries according to total operating expenditures) . 

ERiC 
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Thq. IniLlnl L f/a f:i i: icd rnndom Briinpie w^b thnn draWJi, and It 
conjsi^sUod of 17 librnries from tho Chicago aroa, 20 libraries from 
norl-linrn IllinoiB, 19 iibrarias from cQntiral Illinois^ and 15 
libraries from southGrn IllinoiB^ for a total of 71 librariGS (for 
a broak-down by budget catogory bqq Table 3,)- 

Of thG original stratifiod random samplG of 71 librariQS, 38 
librarins or 54 parcGnt^ agrcGd to ijarticipate in the Illinois 
per formancea rncasurGs iDroject, Table 4 shows a brGak-down of thoscs 
libraries by gGOgraiDhical area and total ojDGrating exiDGndi turos^* It 
appearod that thero was a direct relat ioiiBhip between the total ^ 
oiDerating eKpenditurGs of the libraries and the number of respondents* 
Because of this i^Glationship^ a higher percentage of the original 
sample in the Chicago and Northern geographical areas agreed to par- 
ticipate in the project than in the CGntral and Southern areas* Tables 
5 and 6 show the percentagGS of the total sample by total operating 
GxiDenditures and geographical area* 

The Library Research Center staff cpntacted many of the original 
sample's non-^respondents to determine the reasons for libraries 
declining to participate in the study^ The reasons most commonly 
stated by the head librarians were (1) there was not enough 
time before the study's starting date to obtain the library board's 
approval to participate^ {2) the library wa^ too small and did not 
have enough staff men^Ders to conduct a study- and (3) the library 
did not have enough time to collect the performance measures data 
and provide its customary services as well. 
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TABLE 3 



Qeoqgaphical Area 



GEOGRAPHICAL MD TOTAL OPERATING EXPEffilTURE 
CHARACTERISTICS OF ORIGINAL SAMPLE 

Total Qperatinq, Expendituras 

io-'^.seg 10,000- 20,000- 50,000-- 100,000- 300, ooq^ 



.^ptal Nuinbar 
.of.Librarias 







19J99 


49, M9 


99,999 


299,999 






Chicago 


4 


3 


2 


' ^ 2 


3^ 


3 


17 


Noftharn 


5 


3 ■ 


3 


3 


3 


3 


20 


Central 


4 


3 


3 


3 


3 


3 


19 


Southern 


3 


3 


3 


3 


3 


0 


15 


Total 


16 


12 


n 


u 


12 


1 


71 



TABLE 4 



Chicago 
Northern 
Cintral 
Southarn 

Total 



GEOGRAPHICAL AND TOTAL OPERATING EXPEroiTlJRl 
CHARACTERISTICS OF POSITIVE RESPOmENTS 
OP ORIGIIAL SAMPLE 

Total Operating Expenditure by Thousands 



|0--9,999 10,000-^ 
19,000 



1 
2 
0 

0 

T 



2 
3 
1 
0 

7 



20,000- 
49,999 

2 

3 

a 
1 

T 



50,000- 100, OOO- 
99,999 299,999 



1 
0 
1 
2 

T 



3 
2 
2 
2 

T 



total Numher 



3QQ,OQo+ 

3 
2 
3 
0 

T 



12 
12 
9 
5 

W 



TABLE 5 



PERCENT POSITIVE AND NEGATIVE RESPONSES OP 
ORIGINAL S^PIjB BY TOTAL OPERATING EXPENDITURES 



Total Operatinq Es 


<pendi tures 


PQrcent 






Positive 

Responses 


$0-^-9,999 




19% 


10, 000^-^19,999 




50 
\ 

72 


20, 000 — 49, 999 




50, 000-^-99,999 




36 


100, 000^-299,999 




75 


300, 000+ 




89 


Total 




54% 

TABLE 6 


PERCENT POSITIVE 


AND NEGATIVE 



Percent 

Negative 
Responses 

81% 

50 

28 

64 

25 

11 



46% 



OF ORIGINAL SAMPLE BY GEOGRAPHICAL AREA 

Geographical Area Percent Percent 

Positive Negative 

Responses Responses 



Chicago 70% 

Northern 60 40 

Central 47 53 

Southern 33 67 



Total 54% 46% 

As 38 libraries did not represent the desired 10% sample of 
Illinois public libraries, it was decided to replace the sample li-- 
braries that had declined with libraries of similar budget sizes. 
With the cooperation and assistance of the appropriate systems 
headquarters, 23 substitutions were made for libraries that had not 
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, agreed to particix^ate in the study. For the most par,t^ reiDlacoments 
were liTDraries from the same systems as those that responded nega-* 
tively. With the addition of the 23 substitutes^ the sample con- 
sisted of 61 libraries with a compositlqn quite similar to the original 
sample* The only segments that were left with smaller than desirable 
numbers of libraries were the southern geographical area and the 
$0 — 10,000 budget range. 

In addition to the 23 substitutes^ 17 libraries from two systems 
requested that they be allowed to participate in the study. In spite, 
of the fact that the inclusion of these extra libraries would ad- 
versely effect the randomness of the sample^ it was decided to include 
them in the project. It seemed undesirable to prevent any library 
from taking the opportunity to evaluate their services if they so . 
wished. These extra libraries were fairly well distributed within a 
range of $40,000 to $482,235 on total operating expenditures, and 
they brought the grand total of libraries participating in the study 
to 78, For break-downs of the final sample by method of inclusion," 
geographical area, and total operating expenditures, see Tables 7, 8^ 
and 9. 

TABLE 7 

COMPOSITION OF FINAL SAMPLE BY METHOD 
OP INCLUSION AND GEOGRAPHICAL AREA 

Geographical Area MetKpd of Incluaion 

Original Substituta Extra Total 

Chicago 12 . 9 17 38 

Northern -12 6 0 18 

Central 9 5 0 14 

Southern 5 3 0 8. 

Total 38 23 17 78 
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TABLE 8 

COMPOSITION OF FINAL SAMPLE BY METHOD OF 
INCLUSION AND TOTAL OPBRATING EXPENDITURES 

Total Operating Expenditures Method of Inclusion 

Orlqlnal Substitute Extra Total 



$0—9,999 




3 


1 


0 


4 


10,000 — 19,999 




5 


7 


1 , 


13 


20,000--49,999\ 




9 


3 


1 


13 


50,000—99,999 ^ 




4 


.5 


2 


11 


100,000 — 299) 999 




9 


7 


7 


23 


300,000+ 




8 


0 


6 


14 


Total 




38 
TABLE 9 


23 


17 


78 


COMPOSITION 
AREA AND 


OP FINAL SAMPLE 
TOTAL OPERATING 


BY GEOGRAPHICAL 
EXPENDITURES 






Total Oparatinq Expenditures 




Geoqraphical 


Area 





Chicago Northern Central Southern Total 



$0--9,999 


1 


2 


1 


0 


4 


10,000 — 19,999 


3 


4 


4 


2 


13 


20,000—49,999 


4 


5 


3 


1 


13 


50,000--99,999 


6 


2 


; 1 


2 


11 


100,000 — 299,999 


15 


3 


2 


3 


23 


300,000+ 


9 


2 


3 


0 


14 


Total 


38 


18 


14 




78 
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The final numbers of libraries from each library system agreeing 
to participate in the study were as follows i 

Bur Oak---6 libraries 
Corn Belt™l library 
Cumberland Trail----2 libraries 
Du Page---15 libraries 
Great River— 2 libraries 
Illinois Valley—l library 
Kaskaskia--2 libraries \ 
Lewis and Clark~4 libraries- 
Lincoln Trail- -2 libraries 
North Suburban--18 libraries 
Northern Illinois^ — 10 libraries 
River Bend — 2 libraries 
Rolling Prairie--6 libraries 
Suburb an-- 5 libraries 
Westerii Illinois--2 libraries 

Workshops 

The Library Research Center staff held six workshops across the 
state of Illinois in March and April 1975^ in order to explain the 
use of the Rutgers performance measures manuals The first workshop 
was held in Decatur and was intended for system's personnel only. 
The next four were held in Blooinington, Effingham^ Rockford, and 
Wheaton respectively for one to two ntaff mentoers from each of the 
participating libraries in those areas. The final workshop was held 
in Deerfield for North Suburban Library System members only. (The 

North Suburban Library System had been allowed to include 12 extra 

,1 

libraries in the study^ bring irig thidr nunter of participants to 18, 
so they had requested a workshop for their mefftoers only*) Each of 
the library system headquarters in the state assisted the Library 
Research Center in determining which of its members that had been 
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selected for the study would be attonding a workshop. 

The Decatur workshop was attended by 15 people representing 11 
liTDrary systems and the Illinois State Library, Due to poor weather, 
the workshop at Bloornington was attended by only 11 people repre- 
senting 8 libraries. Attendance at each of the remaining workshops 
was as follows: Ef f ingham--ll people representing 8 libraries, 
Rockford--17 people representing 9 libraries, Ifheaton--41 people 
representing 25 libraries and 3 systems, and Deerf leld--23 people 
representing 16 -libraries* 

The workshops were scheduled for one day from approKimately 9i30 
a^ m. to 4:00 p. m. Each workshop was opened by a speaker presenting 
the background of the performance measures study and the goals of the 
workshop*^ The speakers for the six workshops were, in the same order 
as the workshops, Lucille Wert, Director of the Library Research 
Center, University of Illinois; Gerald Born, Executive Secretary, 
Public Library Association^ Galen Hike, Specialist, Research and 
Statistics, Illinois State Libraryr Donald E, Wright, Librarian, 
Evans ton Public Library; Ruth Gregory, Librarian, Waukegan Public 
Library; and Pat Hogan, Information Librarian, North Suburban Library 
System, Following the opening address, a page-'by-page presentation 
of the Rutgers manual was given highlighting the critical sections 
and providing detailed eKplanations of some of the techniques and 
calculations. The presentations at the workshops basically followed 
the format of the performance measures manual, which included the 
following topics^ 

1, Materials availability-~reGently published books, titles 
already in the library's collection, and periodical 
availability; 

2, Materials usage---in-library circulation, outside the/li-^ 
brary circulation^ and inter-^library loan circulation; 

3, Facilities availability and usage^=user characteristics 
and equipment and facilities availability and usage; and 
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4. Staff avairability and usagG^-public service personnel 
availability and patterns of staff assistance, (See 
Appendix G for a copy of the coinplete rnanual,) 

After the manual presentation, a question and answer period was 
held and the study materials were distributed. Each participating 
library, which had already been mailed a copy of the manual, was 
given user tickets and worksheets for its evaluation. 

Questions and coimnents most often received from partici}^^!ants 
during the workshops included the following i (1) questions about 
the validity of a BPR sample of recently published books (p* 1 of 
the manual), especially for small public libraries, (2) questions on 
the applicability of an inter-library loan measure (p. 30) for indi- 
vidual libraries in Illinois, as nearly all interlibrary loan re- 
quests are processed by the systems, (3) comments that the user tic^ 
kets should have asked more questions of the patrons, (4)^ confusion 
over some of the definitions in the section on public service per- 
sonnel availability (e.g,, the distinctions between assigned, 
available, and assisting), (p, 52), (5) comments that the circulation 
forms (p. 28-9) should have provided for periodicals, (6) comments 
that the title availability forms (p, 16 and 18) should have provided 
for AV materials, (7) comments on the difficulty of measuring 
in--library circulation and (8) general comments on the large amounts 
of time and staff apparently needed to conduct a three^day evaluation 

Near the end of the project, questionnaires were sent to a non- 
random subsample of the participating libraries (see Appendix P) . It 
consisted of 17 libraries chosen to represent each of the budget 
(total operating expenditures) categories and 6 persons picked to ■ 
represent the library systems* Twenty of the questionnaires, or 
95%, were completed and returned. 

Two of the questions in the questionnaire were concerned with 
the performance measures workshops, and those questions along with 
summaries' of their answers follow. 
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7* How helpful did you find the workshop on the use of the 
performance measures manual? (Rate on the following 5-point scale) 



No _ ^ Greai 

Help " Help 

Assigning values of 1 for "no help" through 5 for "great help" 

the 18 responses were summarized as follows^ 

Mean response - 3*58 \^ 

\ 

Median response ^3,50 
Range ^2-5 

Do you have any suggestions for changes in future workshops on 
the performance measures manual? 

Typical responses to the second part of question 7 included the 
following s (1) the workshops should be longer, (2) include more 
input from persons who have actually conducted an evaluation in a 
library^ (3) include more detailed instructions, and (4) include more 
demonstrations. Comments about the workshops were generally favor- 
able, however, and most participants believed that they had been 
adequately prepared to conduct their evaluations. 

The observations of the Library Research Center staff concerning 
the workshops generally agreed with those of the participants. Longer 
workshops with more attention to details of data tabulation might 
well have been more effective, but it is probable that fewer librar*- 
ians would have been willing or able to attend two^day workshops. 
The workshops did appear to adequately prepare the great majority of 
the participants* As the data that was collected by the libraries 
was checked by Research Center staff, it became apparent that most 
of the poorly done evaluations were conducted by libraries not 
represented at any of the workshops* 
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Data Collection 

All sample litorarles were asked to conduct performance measures 
studies during a three day period/ to collect performance measures 
data on the items listed on page 14, \to tabulate their data as 
instructed in the manual, and to return the results to the Library 
Research Center within approximately four weeks from the dates of 
their respective workshops* As' suggested in the manual, the li-- 
braries were requested to select three days, within the same week 
if possible, that would reflect all of the various types of activi- 
ties to be measured* They were also asked not to advertise in ad- 
vance, or at least not to indicate the exact data coriection days, 
to avoid affecting the results for their libraries. 

It was found that most of the participating libraries apparently 
required more than four weeks to plan and conduct their evaluations, 
tabulate their data, and forward results to the Research Center 
This tardiness was expected, but it was considered necessary to setx 
a fairly early deadline in order to encourage prompt returns. The 
last workshop was held on April 15, 1975, and the last return was not 
received until July 18, 1975. 

Before the . libraries began to actually collect data, six li- 
braries indicated that they were dropping out of the study, thereby 
reducing the nuntoer of pal|^icipants to 72. In addition, six more 
libraries never completed their evaluations and consequently did not 
return any data to the Research Center. The remaining 66 libraries 
did conduct their evaluations and send their results to the Research 
Center, and that constituted an 85% rate of return for the 78 li- 
braries in the final sample. 

During the data collection period. Library Research Center staff 
and systems personnel who had attended the first workshop attempted 
to resolve any problems encountered by the participants. In a few 
cases, systems personnel actually assisted libraries in the collection 
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and tabulation of their data. Soma of the systems headquarters re- 
viewed their men^Der libraries* data before forwarding them to the 
Library Research Center. The Library Research Center staff's 
imiDression of the data that was received from the participants was 
that generally most of it was properly collected and tabulated. The 
larger libraries and the libraries that had been represented at the 
workshops tended to provide the best quality data in terms of 
accuracy arid thoroughness, 

However / there were a variety o£ problems and errors in the data 
received at the Research Center, and it was^ found necessary to devote 
a considerable amount of time to preparing the data for computer 
coding and analysis. Some problems encountered in the data collect- 
tion resulted from the manual -s being designed for a one--day data 
collection period rather than for the three-day period used in 
Illinois, 

The sections of the manual that the Research Center staff found 

to be the most common trouble spots are listed belowi 

■1, Recently Published Books (p, 1 of the manual) --this section 
was almost always performed correctly, but some of the li^ 
brarles did skip it, apparently because they believed that 
the BPR sample had little validity for their libraries. 

2, Titles Already in the Library's Collection (p. 6) --few 
participants encountered difficulty in performing the 
shelf list measurements and calculations, but soma skipped 
this section because they anticipated problems. Several 
libraries drew samples of their shelf lists which resulted 
in less than or more than the 500 titles recommended in 
the manual V 

3. Usar Characteristics (p, 32) — various totals that should 
have. balanced often did not. For example, the total num- 
ber of , students and non-students often did not equal the 
total nun^er of patrons. Such in^alances appeared to be 
due to errors in sorting user tickets, inconsistencies 

in counting patrons as students or non-students, and 
problems with " nO'-responsas • " 
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Sevejral participants had difficulty with the "Length 
of Stay-' tabulations, largely because they misunderstood 
the meaning of the time intervals. At least two li- 
braries considered the time intervals as time of arriv- 
al points rather than length of stay intervals* 

4, Equipment and Facilities Usage (p* 46) --several partic'- 
ipants simply miscalculated the utilization factors 
displayed on page 50 of the manual, 

5* Public Service Personnel Availability (p, 52) ---several 
libraries miscalculated the availability factors, ap- 
parently because they did not understand the distinc- 
tion between "available" and "assisting". In addition, 
not all libraries interpreted "available" the same, so 
not all of the availability factors were calculated on 
the same basis. Two or three participants turned in 
questionable availability factors^ but they did not 
provide enough data to allow the Research Center staff 
to check their calculations. 

6. Patterns of Staff Assistance (p, 55) --there appeared 
to be few difficulties encountered in this section 
except in the cases of a few libraries that were both 
local libraries and systems headquarters In these 
particular libraries, it was difficult to distinguish 
between questions directed to the systems' collection 
and to the local collection, A few libraries collect- 
ed these data for only one day, apparently because 
they simply were unable to devote three full days to 
the collection of the necessary data for this section. 



As noted above, each library that participated in the performance 
measures study tabulated its own data* These tabulations were then 
sent to the Library Research Center, either directly or through the 
appropriate system headquarters. After the data was received at the 
Research Center, it was checked for completeness and accuracy* If a 
significant amount of data was missing from a library's returns, that 
library was contacted* In a few cases, a library was able to locate 
all or part of the missing data and return them to the Research Center, 



Data Analysis 
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Having the x^^^'ticipants tabulate and sumniarize the data collected 
on their user tickets and complete all of the other forms and sum^ 
mary sheets, resulted in a considerable savings of time for the Li- 
brary Research Center. For example, for the earlier pilot study 
conducted by the North Subut^ban Library System (:jee p. l and 
ApXDendix A), the Research Center had to process over 45,000 user 
tickets. As mentioned earlier, the Research Center staff still had 
to devote a considerable amount of time to checking and correcting 
the returns, but if the libraries had not done their own tabulations, 
the data analysis would have taken much longer. 

In addition to the savings in time, other important benefits 
were gained by requiring the libraries to tabulate and summarize 
their own data. This process provided a better test of the manual's 
ability to be self-explanatory and of the participants' abilities to 
conduct their own performance measurements. 

After all of the returns were checked and corrected, the data 
v;ere coded and keypunched, A FORTRAN computer program was written 
to analyse the data. The program was designed to produce a printout 
for each library that presented its "scores" on many of the perform 
mance measures, and, for purposes of comparison, the corresponding 
mean, median, and range scores for all of the Idiraries in the same 
budget categoryp Each printout, or profile* was fully labeled and 
required no additional editing. An individual profile was printed 
for each of the 66 libraries that returned performance measures data 
to the Library 'Research Center* (For a copy of a sample profile, 
see Appendix I*) 

It should be noted that the scores presented on each profile 
were not necessarily norms . Norms are often considered to represent 
ideal patterns or levels of achievement, and that is not what the 
performance measures score represented. However # the scores were 
quite comparable to norms more conservatively defined as standards 
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of dGvcslopment or achievement derived from the average or median 
achievGnicint of a large group. Therefore^ each library was encouraged 
to i;iterpret its scores as indications of how well it was performing 
---- in comparison to other libraries of a similar budget size^ and not 
to consider the gro.up scores as ultimate goals or ideal levels of 
performance* In. addition, each library was cautioned that a meaning- 
ful intetrpretation of a profile required that a specific score or 
measure be considered in connection with other measures and relevant 
local factors rather than studied as a single, isolated\f actor- 
After the data analysis was completed> the profiles'^ along with 
the original tabulations and cover sheets, were sent to the Illinois 
State Library for distribution to the participating libraries. 



A major objective of tKis project was to test the Rutgers 
performance measures manual on a sample of Illinois public libraries 
of varying slEes, In order to encourage feedback on the experiences 
of the libraries participating in the study^ they were invited to 
include relevant comments with their performance data* Several of 
the participants did enclose coiranents with their study results, and 
the most representative ones are paraphrased below* 

1*. The BPR sample in the section on Recently Published Books 
(p. 1 of the manual) was too time consuming and of ques^ 
tionable value, especially for small libraries* 

2, The procedures for sorting user tickets (p. 35-6) were 



3. The section on Patterns of Staff Assistance (p* 55) was 
not meaningful for small libraries. 

4. The Materials Availability measures (p* 1-22) required 
a lot of time and effort but did produce valuable pro- 
files of a library's collection* 



Findings 



difficult to understand and too time consuming* 
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5* The various measurements did not present a complete 
picture of Illinois public libraries because of the 
availability of system resourcss, 

6. The tabulation procedures ware time consuming but 
generally easy to follow, 

7. Nearly all patrons were willing to fill out user tic- 
kets. 

8* A significant amount of volunteer help^ especially in 
the small libraries, was necessary to conduct an 
evaluation , 

9, The measures had value but need refinement. 

10. The performanee measures should include more subjective^ 
qualitative measures . 

11. This method of measurement holds considerable promise - 
but is still lacking in suitability for small public 
libraries, 

12- Volunteers were responsible participants in carrying 
out the evaluation. 

13, Most staff members were enthusiastic and cooperative, 
in spite of the demands on their time. 

14. The periodical ^Availability sample (p. 20) was not 
valid for small libraries. 

15, It was difficult to obtain an accurate random sample 
of shelflists because of human error. 

16. The evaluation was an interesting experience but too 
time consuming. 

17- The instructions were clear and well org^inized. 

18* A three-day study is not long enough to get reliable 

statistics on many of the subjects covered* 
19. Some of the worksheets (e.g., in--library circulation 

and equipment and facilities) were not large enough to 

use as actual tally sheets. 
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general, the particiiDating librar-ians saemGd to bQliave that 
t}i0 ^^^luati^^^s required a lot of timm and staff, but they still con- 
sid^^^4 thB ^t\^dy worthwhile and were anxious to reGeive rGSults. 

addition to the cormTients firom participants that were received 
s^loi'^^ with th^j^^ measurements data, eight questions in the previously 
in^n^^^ned questionnaire also solicited reactions to the study from 

^5 tha I^^ttic'ipants . Seven of those eight questions and their 
typi^^l ans^^^s (o^ summaries) follow, (Question number 7 was pre- 
s^n^^^ on pag^. 16 J \ 

ApP^^Xirnately how many staff hours were needed to prepare for 
th© t^^ge-^day performance measures study of your library? 
ji^ean response = 20 hours 
jwiedian response = 15 hours 
pange = 2-60 hours 
^ * App^^5<imately how many staff hours were needed to organise 
and t^^^iate the data collected during the three-day per- 
foriT^^nce measures study? 

I^ean response — 45 hours 
l^edian response — 38 hours 
pange - 6--150 hours 
Eo^ ^^ny extra persons (e*g-, volunteers/ temiDorary employ-- 
eeS/ mtc^) f if any* were needed by your library to complete 
the t>^^ge-day study and tabulations? 
j^ean response - 5*6 persons 
j^edian response — 2 persons 
^ange 0-32 persons 
4^ Xfi y^^x opinion^ is the performance measures manual suf- 
fici^t^tly self-eKplanatory? 
iJo ^ 7 responses 
^/ Yes - 10 responses • 



Qualified yes ^ 4 responses 
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what prolDlGms did you Gncounter in connection with the per- 
forrnancs mQasures manual and/or the three day study? 
a. None, 

to* Required too much staff time. 

The manual was better suited for large lilDrarles. 

d. Patrons were not consistent in marking user tickets 

e. Staff and volunteers were not consistent in their 
methods of collecting data* 

f* Tabulation of user tickets* \^ 
g« Ambiguous questions on user tickets. \ 

h. Cl. ^gorization of questions in Patterns of Staff 
Assistance section were difficult, 

i. In-circulation counts, 
j. Tabulations, 

k. Too many different forms to keep track of. 
Which portions of the performance rneasures study do you 
expect to be the most helpful in the administration of your 

library?.^ 

a. User information (most frequent response,) 

b. Title availability statistics* 

c. Equipment and facilities use, 

d. Circulation .statistics 
e* Staff availability. 

The least helpful? , 

a. Equipment and facilities availability (most 
frequent response) * 

b, BPR sample 

c. Periodical availability, 

d, in-library circulation county as patrons often 
reshelved their books. 

e* Staff assistance patterns. 
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8* What is your gGneral oiDinion of the perforinanGe niGasuires 
nmnual as a tool for assisting in the evaluation and 
impx^ovGniGnt of your libi^ary? 

a. Would be better if it were "scaled down", 

b * Needs refinement, 

c» Too time consuming. 

d* Needs to be modified for small libraries - 
e, h reliable method of measurement. 
^ f. Helpful. 

g. Needs to be modified if it is to be self-expi^na-- 
tory. 

h, h useful tool* 

Library Research Center Staff reactions to the performance rne^_ 
sures study were generally similar to those eKpressed by participants^ 
However^ there are a few staff observations about the manual and the 
management of the study that were not made by th6 participants, if 
they were made, they are worth repeating. Those observations follow^ 

1, The Equipment and Facilities Usage section (p, 45) called 

r 

for equipment and facilities to be divided into adult and 
juvenile lists, but subsequent forms did not provide for 
breakdowns by adult and juvenile. 
2* A few libraries were so small they did not have a shelf list^ 
and special arrangements had to be made for those libraries 
to draw their sample of titles from their card catalogs. 

3. The utilization factor for equipmeht and facilities was 
difficult to interpret as it can exceed 

4. The BPR and periodical samples were the most criticized sec- 
tions, of the manual. - 

5. The sorts of user tickets were difficult and time consuming, 
and the "length of stay*' measurement was not readily clear 
to everyone. 
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6, ThGre was considerable confusion over the counting of seats in 
rtiGGting rooms in the Equipment and Facilitia^ Usage Section. 

7, The "available" and "assisting" categories in the Public 
Service Personnel Availability section (p. 52) caused a lot 
of problems. 

Suggestions for Manual Revision 
In addition to the suggestions for revisions of the performance 
measures manual that can be inferred from some of the previously 
listed comments and questionnaire responses^ the following specific 
suggestions were received from participants and/or made by R&search 
Center staff: 

1. User Characteristics s Form IV should have a "total" column. 

2. User Characteristics^ Form V should have a "total" column. 

3. User Characteristics i Form VI would be more useful if it 
asked for percentages for each "satisfaction" category. 

4* User Character istics i Form VII should have "totals" for 
"student" and "occupation" categories, 

5. It would be helpful if the manual indicated which totals or 
subtotals should match, in order to catch errors in the 
calculations . 

6. Title Availability Sample: Form III should have a row for 
materials with no publication dates, 

7. All of the forms with time listings (library hours) should 
include the 8:00 a,m,-9i00 a.m. and 9^00 p.m.-lO^OO p.m* hours. 

8- Make the listings of equipment and facilities consistent on 

pages 47, 48 and 50. 
9. Add a total column to Equipment and Facilities i Form II. 
10. Directions on how to count shelf list cards indicating multiple 
copies or multiple volume sets should be added to the section 
on Titles Already in the Library's Collection, 
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11. Columns for AV materials and/or periodicals should be added 
to Title Availability Sample^ Form II and Form III^ and 
Circulation Distribution* Form I and Form II, 

12. The forms for In-Library Circulation and Equipment and Facil- 
ities that are used as tally sheets need to be larger. 

13 • The time scale at the top of the user tickets should be re- 
vised to facilitate sorts on time intervals, 

14. A form asking for daily totals of in-Library circulation by 
date of publication is needed, 

15. If used for more than one day^ all of the forms should pro- 
vide a space for the date. 

16. An analysis of In--Library Circulation by Dewey class would 
^ be useful. 

17. On the user ticket, "grade" should be changed to **grade level" 
question #5 should state whether only library cards issued 

by that particular library or any library, cards accepted by' 
that library indicate a "yes'*' answer. 

18. A sample of titles from Public Library Catalog or some other 
recommended bibliography for public libraries should be 
substituted for the BPR sample. 

19. Provide forms for the tabulations of Public Service Personnel 
Availability factors. 

20. Provide a more extensive list of sample occupations. 

21. Add "no response'- columns to User Characteristics s Form I 
and Form II. 

22. Add rows for "records" to In-Hbrary Clrculatiorii Form I 
and Form II. 

23. Revise the estimates of the time required for the various 
measurements (p, k) . 

24. Add a row for a nonfiction subtotal to Title Availability 
Samplei Form II. 

o 31 . 
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25. In thG section on Titles Already in the Library's Collection, 
indicat© how biographies that are classified as "B" should 
be treated* 

2 6. In the section on user charactaristics, clarify the distinc- 
tions between full'^time students and part-^time students with 
part-time jobs, and between full-^time housewives and house- 
wives with part-time jobs. 
27* Add pre-school categories to User Character isticsi Form IV^ 

Form VI, and Form VII* 
28, In the sect'lon on Public Service Personnel Availability^ 

indicate how availability factors should be determined for 
libraries too small to ?iave seiparate departments or areas. 
Additional minor revisions necessitated by typographic errors in 
the manual and changes desired by the Library Research Center staff « 
were included in an "Errata and Addendum" supplement that \^as given 
to every participating library (see Appendix H) * 

Summary and Conclusions 

In summary, the project entitled "'Measurement and Evaluation of 
Public Library Services," which was funded by the Illinois State Li=* 
brary with LSCA funds, was conducted primarily to test the performance 
measures manual developed at Rutgers, 

In order to achieve that objective^ the University of Illinois 
Library Research Center drew a stratified random sample of 71 p\A>llc 
libraries representing major budget categories and geographical areas 
within the state of Illinois, Of the original 71 libraries, 38 li- 
braries agreed to participate in the study. In addition^ 23 libraries 
agreed to serve as s\^stitutes for original sample libraries that had 
decided not to participate. An additional 17 libraries asked to be 
included in the performance measures study, and this brought the total 
number of participating libraries to 78, 
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The Library Research Center staff held six workshops across the 
state of Illinois to instruct the librarians in the use of the per- 
formance measures manual. All participants were asked to conduct a 
three-day performance measures study, tabulate and summarize their 
data, and return the results to the Library Research Center* Sixty" 
six libraries, or 85% of the 78 participants, eventually did return 
results to the Research Center. 

After all of the data was received by the Library Research Cen- 
ter* a computer program produced for each library a "profile" that 
presented that library's "scores" on many of the performance measures, 
and, for purposes of COTiparison, the corresponding mean# median, and 
range scores for all of the libraries in the same budget category. 
These profiles were then sent to all of the participating libraries* 

In order to gain additional feedback on the performance measuree 
study, questionnaires were sent to a non--random subsample of the 
participating libraries- The sample consisted of 17 libraries chosen 
to represent each of the budget categories and 6 persons picked to " 
represent the library systems. 

As stated in previous sections of this report^ the findings of 

this study were generally encouraging. Most of the participating 

libraries were entirely capable of conducting a performance measures 

study and of tabulating and summarizing the resultant data. 

The Library Research Center staff did find it necessary to de- 

■* * 

vote a considerable amount of time to "cleaning" the data, but this 
was due more to the large amount of data generated by 66 libraries 
than to general misunderstandings of or deficienceis in the perfor- 
mance measures manual- Most libraries found the manual reasonably 
clear and the instructions sufficiently easy to follow* 

This report has listed a fairly large nuntoer of items that caused 
some difficulty for one or more libraries, .but these trouble spots 
tended to be relatively minor. In addition, several measures which 
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met with varying amounts of resistance from the participants are 
listed. But these items v/ere opiDOsed on the basis of thair relevance 
to the study or their validity for particular types of libraries 
(especially small libraries) and not for deficiencies in their methods. 

The Library Research Center staff's greatest disappointment in 
the performance measures manual \s7as that it took a rather traditional 
approach to the evaluation of public library services* The indicators 
of performance which were measured by the manual are similar in jiature 
to statistics which have long been collected by libraries. However, 
Uie manual did incorporate more of those measures than any document 
to date^ and it did introduce a few new indicators (e*g,^ public 
service personnel availability factors) * 

^11 in all/ the performance measures manual appeared to be a 
useful tool capable of providing library administrators with substan- 
tial data for evaluating their libraries* services* It indicated a 
tremendous amount of planning * and most of the various instructions 
had been thoroughly thought through. 

Suggestions for Further Research 

As stated above^ the many instructions in the Rutgers performance 
measures manual seemed to have been carefully developed and were 
clearly presented. Yet, libraries that participated in the training 
workshops generally returned better-tabulated data to the Library 
Research Center than did those libraries that did not participate in 
the workshops. Therefore, it would appear that even more detailed 
instructions are necessary if the manual is to be entirely self- 
explanatory. Additional research would be helpful in revising some 
of the instructions in order to reach that end, 

in addition, it was clear from this study that further research 
is needed in order to refine the manual so that it will be more 
acceptable to, and valid for^ small public libraries* 
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Thirdly^ the Library Resaarch Center staff iDelieve that it v;ould 
be dGslrable to intagrate more sub jectivc-- type measures Into the 
manual* One way of accomplishing this vould be to expand the User 
ticKet, Another method would be to distribute user questipnnaiares' to 
a sample of the jDatrona as was done in the St, Petersburg/ Florida, 
study. Obviously, additional research would be needed to develop 
such tools* 

And finally, it is suggested that future studies involving li- 
braries as participants include follow-^up activities designed to pre- 
sent the results of the studies and to aid the libraries in the 
interpretation of their individual reports * The interpretation 
element is essential if the participating librarians ar© going to 
be able to apply study data to the administration of th^i^ libraries. 
It is also important that participants receive enough feedback from 
such studies to encourage them to begin systematically Evaluating 
their library services rather than merely participating in single, 
isolated research studies. 
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FOOTNOTES 

^Ernest Deprospo^ Ellen Altman, and KGnneth E* Beasley^ 
Performancg Meag urss for Public Li brarlGri ( Ch i c a g o i The Pub 1 i c 
Library Association of the American Library Association^ 1973) , 

2 

Ernest R, DeProspo et al*. Performance Measures for Public 
Libraries! a Procedures Manual f or the_Collection and Tab ulation 
of Data (New Brunswick^ New Jerseyi Bureau of Library and Infor^ 
mation Science Rescaarch^ Rutgers University, 1974) « 

Report on Library User Surve y, 1974. (St. Petersburg, 
Florida: Management Improvement Department, 1974) * 

%eet'ing the Challenge: Illinois State Libra ry*s Lonq -Ranga 
Prog ram f or Library Development in Illinois, 1974-1979 , Sec . 106 . 2 
and 106.3 

/ 

^"Illinois Public Libraries Statistics, 1973-1974," Illinois 
Libraries, Vol. 56, No. 8 (October 1974), p. 585-605. 
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ANNOTATED BIBLIOGRAPHY 



Bailey, Andree* ^'Standards for Library Service in Institutions s in the 
Correctional Setting*" L ibrary Trends, 21(0ctober 1972), 261--6. 

The first official standards for library servica in adult correc- 
tional institutions were approved in 1943. New standards were in the 
process of being written in 1972* These standards for correctional 
institutions included* importance of a trained librarian, a regular 
library budget, well-selected materials and suitable quarters. They 
also specified numbers of people and volumes per population served. 
The new standards were written in a functional rather than organlza^ 
tional manner. 

Blake, Fay and Edith Perlmutter. "Libraries in the Marketplace." Library 
Journal,. 99( January 15, 1974), 108-11. 

^A discussion on charging for information vs. free libraries is 
given* The authors are in favor of free libraries and additional 
XDublic support. 

Brown, Helen M. "College Library Standards." Librar y Trend s, 21 (October 
1972) , "204-8. 

The author outlines the historical background which lead to the 
1959 standards. Each set of standards, beginning in 1928, became 
more specific. The 1959 standards present a comprehensive guide to 
good library administration and include quantitative measures. Re- 
vision is required to bring it up-to-date. 

Clapp, Verner W. and Robert T. Jordan. "Quantitative Criter^ia for 

Adequacy of Academic Library Collections." Colleqe and Research Li - 
braries , 26(SepteniDer 1965), 371-80. 

The authors argue that the Sta ndards for Colleqe Libraries and the 
Standards for Junior Colleqe Libraries are inadequate for estimating 
the sizes required for minimum adequacy by libraries of academic 
institutions of widely differing characteristics. They developed new 
formulas which attempt to identify the principal factors affecting 
academic needs for books and to assign suitable weights to each fac- 
tor. They then illustrated the application of the formulas to specif- 
ic institutions / but decided that while the results are useful, 
further research is needed. They did conclude that it is possible to 
provide a meaning ful' quantitative measure of adequacy in library 
collections. 

Cowgill, Logan O. and Robert J. Havlik. "Standards for Special Libraries," 
Library Trends , 21(0Gtober 1972), 249-60. 

Diversity is the most common element i-: describing special li- 
braries since they are an integral pari of the institution they serve. 




37 



34 



Standards v;hich include the objGctivGS of the pai?ent organi?'.ation 
have been written for various groui?s of spQclal libraries. Law, 
mGdicine, and governmGnt have served as quidGlines for special li*-- 
braries. 

Crowley, Terence and Thomas A, Ghilders, Information Service in pu blic 
Librariesi Tvyo Studies * Metuchen, New Jerseys Scarecrow, 1971. 

Crowley and Chi Iders present two sequential studies of the rela- 
tionship of quantitative librai^y statistics to qualitative informa- 
tion service* Crowley considered both in-person questions and 
telephone questions^ while Chllders limited his study to telephone 
'.inquires. Both researchers focused on the relationship between a 
high degree of monetary support for library service and ability to 
accurately deliver factual information. Both used a set of moderately 
difficult questions and trained personnel to act as anonymous question- 
srs in a selected -group of New Jersey libraries. 

Only 55 percent of Childers' questions (64 percent if questions 
not attempted are not considered to be incorrect answers) and 36 per- 
cent of Crowley's questions were answered correctly* 

Crowley found no significant relationship between the accuracy of 
answers and total expenditures and/or per capita support, Childers 
did find a significant relationship between total expenditures and 
the accuracy of responses, 

DeProspo, Ernest R, "A Study of Evaluation: Measurement of Effective- 
ness of Public Library Service." Wisconsin Library B ulletin, 69 
(January-February 1973), 7-10, 

Ribbens^ Dennis* -'How Well do You do?*' Ibid,-, 3-6, 

De Prospo ' s article is essentially a short summary of his "Mea- 
surement of Effectiveness of Public Library Service." He does note 
a few conclusions drawn from the MjA study i (1) the local library 
is capable of collecting the desired information within tolerable 
error limits, (2) the criteria developed can provide the basis for 
individual profiles of libraries as well as uniformly comparative 
bases, (3) not all aspects of the public library program are appro- 
priate to quantification, and (4) the measurement indicators can be 
developed for the^ local library, a given library system, or a 
national reporting system, 

Ribben's article is essentially a synthesis of some of the prob- 
lems connected with measuring and evaluating public services in 
public libraries. He argues that an evaluation should combine both 
quantitative and qualitative measures. 

Dick, Elizabeth and Bernard Berelson* "What Happens to Library-^Circulated 
Books?" Library Quarterly , 18{April 1948), 100-7, 

This study attempted to determine the extent to which a public 
library's data on its circulation service represent an accurate index 
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of actual sorvice. Circulation figures (for the one library invest 
igated) underGst imahad the library's imx^act in their measure of the 
gross contact between the library and the coinmunity, in that the li 
brary rcaclied about half again as many people as it had borrowers, 
and it provided them with about one^fifth again as many books as it 
circulated. 

Circulation figures overestimated the library's impact in terms 
of actual reading, in that a small iDroportion of the books checked 
out were not read at all and only two-thirds of them were read in 
their entirety* 

The researchers concluded that in terms of "actual service" the 
public library had a slight margin on the credit side* 

\ 

Downs, R, "A Survey of Purdue University Libraries." Indiana Slant , 
30(Iviarch 1968), 5-6* 

Downs and Seibert cited 11 reasons why libraries were usedi 



1. 


Course required 


2. 


Self improvement 


3. 


Pleasure reading 


4. 


Borrow material for further reading 


5. 


Research for term paper 


6. 


Research for graduate exam or thesis 


7. 


Research for publishable paper or book 


8, 


Xerox 


9. 


Return materials to library 


10. 


Do home work with own books 


11. 


Ask questions which do not require borrowing (rsference) 



Drexel Institute of Technology, Problems of Library Services in Metro - 
politan Areas > Eastern and Southeastern Seminar on Problems of 
Library Services in Metropolitan Areas, November 1965, Directed by 
Dorothy Bendix and co-sponsored by American Association of State 
Libraries of Drexel Institute of Technology* Philadelphia i DreKel 
Press, 1966, 

The participants were made up of planners and policy makers at 
the state and metropolitan library levels * The seminar discussed 
the problems and trends of urbanization; the problems of metropolita 
library service; and the implications for state library agencies, 
their problems, their role, and their increasing responsibilities* 

Drexel University, Graduate School of Library Science* Measuring the 
Quality of Pi^lic Library Servi ces; a R eport to Participants . 
Philadelphia, 1972* ED 077 539 

Thomas Childers reports that the purpose of the workshop was to 
explore attitudes toward service, discuss the many facets of mea-- 
suring library services and get a close--up view of one particular 
method of evaluating services: "hidden testing"* Informal proceed- 
ings of the workshop includei (1) a talk by Ernest De Prospo 
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entitled "The Measurement Art^'* giving the general state of public 
library measurement and some new techniques that are currently being 
eKplored, and (2) two talks by Childers--a discussion of recent stud- 
ies that have involved the hidden testing of library services^ and a 
summary of the workshop with recommendations for future activity* 

Durham University, Proiect for Evaluating the Benefits from University 
Librariesi Final Report . Durhami University Computer Unit^ 1969* 

During 1966-69 a team of investigators studied the university 
libraries of Durham and Newcastle, and developed a planning model* 
This final report discusses the survey techniques used, a sampling 
of the data collected, a discussion of the modelling methods, and 
suggestions for further research. 

Factual data presented in the report Includes reactions of Dur-- 
ham academic staff to a personallEed current awareness service, 
length of library visits, frequency of undergraduate use# user ac^ 
tivities within the ribrary, times for users to perform various 
activities, searching methods of library users, effect of distance 
on library visits, relation between lectures and library visits, 
staff and student borrowings by subject, and the library staff time 
needed to perform various tasks. 

Evans, Charles* Middle Class Attitudes and Public Library Use * Little-- 
ton, Colorado^ Libraries Unlimited, 1970* 

This study compared the attitudes of library users and nonusers 
who were registered voters in Oceanside, California* The subjects 
of the study were middles-income persons whose educational attainments 
were sufficient to enable them to use their public library easily. 
It was found that the attitudes of the library users among the sub-- 
jects were significantly more favorable to the public library than 
were the attitudes of the nonusers, but the attitudes of both the 
users and the nonusers were generally favorable to the library. 
There were three significant differences in personal characteristics 
between the user and nonuser groups. The members of the user groups 
had completed more years of school^ a larger percentage of them were 
women# and a smaller percentage of them were newcomers to the city. 
The major conclusion is that attitudes toward the library niay have 
an important influence on public library use. 

pussier, Herman A. and J* L. Simon* Patterns in the Use of Books in 
Large Research Libraries . Chicagoi University of Chicago Press, 
1969, 

This book describes an investigation of statistical procedures 
for predicting with reasonable accuracy the frequencies with which 
groups of books with defined Gharacteristics are likely to be used 
in a research library. The study emphasizes the ever-'inGreasing 
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res^^tch libraries and the possibility of cutting library 
hy mO^^Mq little-used materials to compact storage. Much of 
t}^0 ^^Udy fo^^ses on the feasibility of determining cheap and reli- 
abj^ ^Ules deciding which volurnes should be sent. The authors 

mQ30^t^ reliability primarily in terms of the ability to predict 
tho^^ Volume® which will be used least in the future. The most 
r^ji^^le ptfS^ictio^ of the use of monographs for libraries with cir-- 
^UJ^^^On reC^t^g going back 20 years was the length .of time since 
t}^0 ^^st ci^^^lation (or accession) . 

^^^^dit^e^' G. '*The Empirical Study of Reference," Colleqe and Re - 

M^(^^k^^0S4^^ 30 (March 1969) , 130-55, 

'^^is st^^V reconstructs four empirical studies of referencei 
Dor^^^y Col^' *'An Analysis of Adult Reference Work in Libraries;" 
P^^J ^teed# ''^h Analysis of Reference Procedures in a Large Univer^ 
^it/.^ibra^y'* '* Sa^i Mary Herner, "Determining Requirements for 

B^tof^^^ Energy info^ni^tion from Reference Questions;" and G, Carlson^ 

, S^^qfcSb ^^^trgt^^^y Reference Librarians. It contends that the prin- 
cj^p^i notio^^^ on which these studies are based are deficient. The 
B^x^dY Qoncl^^^s that the empirical interpretation of the conventional 
c^On^^^t is f^^ttless as a framework for the development of the em- 
Pii^^^^X study of reference. The article suggests that reference is 
a s^^^ial c^^^ of problem solving and proposes a new framework 
(pr^^^^ol a^^^Vsi^) for the empirical study of reference, 

Gelfai>^/ ^orris ^* "Techniques of Library Evaluators in the Middle 

Sta^®^ Association*" college and Research Libraries ^ 19(July 1958)^ 
305^20/ 

"^his st^^^ concerns Itself primariD^y with the techniques cur-* 
^^j^^iy used library evaluators in the Middle States Association 
of leges Secondary Schools, It deals also with library 

©v^J^^tion/ S^hefsl institutional evaluation^ and accreditation by 
the ^^sociatl^ri in order to provide appropriate^ indeed necessary# 
b^cl^^^'^und f^-^ i^atter understanding of the task of the library eval- . 
u^t^^' *■ Tb® ^^tbor emphasises tha;t the effectiveness of the outside 
evQ^i^^tion^ i^ large part^ depends upon the quality of the self- 
evaJ^^^tion -wl^^Qh the institution is encouraged to make, 

fiolQjjQ^. ^^j^bert/ ^d- Research Methods in Librarianshipi Measurement 
j^g^^lX^luatiS^* Urbana- University of Illinois* Graduate School 
of pi^tary S^i^nce, 1968- 

B^a^^^V* KeJi^^th E. "A Theoretical Framework for Public Library 

^Ster Bti ^^eril^S discussion on the interrelationship of standards 
ana ^ ^tatistiQal reporting system^ the author presents a formula 
£0;^ P^tenti&l feublic library service and then explains the develop- 



EKLC 



41 



ment of the various elements of the formula. , The author is con- 
vinced that such Gonsideration of the quantifiable elements of li- 
brary service is necessary if there is to be any real brealcthrough - 
in developing meaningful standards, 

Armstrong^ Charles M. "Measurement and Evaluation of the Public 
Library," 15^24. 

The author describes the major problems encountered in measuring 
public library services. Most of his data and examples are drawn 
from the New York State User Survey^ He argues that the basic ele- 
ments of a good measurement include assurance that a measurement 
really defines a good library, understanding the difference in use 
^ among different kinds of people, realising the importance of unit 
costs, and awareness of the need for new measures to reflect the new 
problems of systems and the resulting cooperative relationships. He 
concludes that careful development and consideration of the various 
modes of measurement can contribute materially to the success of li-- 
brary planning in spite of the many deficiences and defects still 
existing in those modes, 

Hamburg, Morris, Leonard Ramist and Michael R, W. Bommer. "Library 
Objectives and Performance Measures and Their Use in Decision 
Making*" Library Quarterly , 42(January 1972) , 107-28. 

The authors argue that for optimal allocation of limited funds, 
it is necessary for libraries to develop measures of output (bene- 
fits) , Various forms of user exposure to documents are discussed in 
an effort to develop such measures for public libraries. It is sug- 
gested that the accrual method of accounting be used to compare such 
^ -—measures -with-costs, and an illustrative computation^ %s^ presented i — 
It is shown how size of user population, amount of exposure, and 
costs for a given year can be estimated. Similar techniques are 
suggested for evaluation of library' programs. This approach is then 
compared with current concepts of library standards. The paper con- 
cludes with suggestions for further research, 

Hamburg, Morris, et al. A Systems Analysis of the Library and Informa - 
tion Sci ence Stati stical Data Systemi the Preliminary Study . Inter- 
im Report. Philadelphiai University of Pennsylvania, 1969. ED 035 
421 

The long-term goal of this investigation was to design and es- 
tablish a national model for a system of library statistical data. 
This is a report on the Preliminary Study which was carried out over 
an 11 month period. Its objective was to design and delimit the 
Research Investigation in the most efficient and meaningful way. 
The Preliminary Study concentrated on (1) the background research 
required to determine the nature and relevance of previous and on- 
going research in this field and (2) the design of the Research 
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Investigation* The Preliminary Study included a literature search 
and review of relevant research; interviews with a variety of li^ 
brarians^ officials of library associations, government officials^ 
and university researchers^ and other activities relevant to the coi^^ 
struct ion of the design of the Research Investigation * This fin^i 
report primarily consists of a proposal for the Research Investiga^-. 
tion and a summary of a background study on "Statistical Measures 
Required for Library Managerial Decision Making Under a Planning^ 
Programming--Budgeting-System (PPBS) 

Henne, Frances* "Standards for Media Programs in Schools-" Library 
Trends , 21 (October 1972), 233-48, 

The succeeding standards from 1945 to 1969 are analyzed, poiiitirig 
out how they are integrated into the school programs. Objective of 
the standards is defined as providing teachers and students with th^ 
media services and resources to which they are entitled, 

Hershfield, Allan P. and Morrell D, Bone, eds. "i\pproaches to Meas^iiri^^g 
Library Ef f ectivenessi a Symposium," Syracuse University, 1972* 
(Frontiers of Librarianship, No. 14) , 

The speakers each felt that it is possible to measure effective^ 
ness. All libraries currently measure administratively convenier^t 
data. What is needed is to measure data in an interactive envis^^ii- 
ment of use and time. 

^ De Prospo outlined the methodology to be used at Rutgers and 
presented arguments , for use of statistical approach, Taylor stire^g^^ 
the "dynamic nature of service, emphasizing measure of use, time 
and success. Daugherty brought up the role of staff in the effective 
uses of libraries. 

Running through the symposium was a feeling that the function qj 
a library has changed from a collection depot to an information 
source element, and that we need to look at how and why it is useq^ 
The institution is to communicate with its users in a dynamic fa^hioj^ 
necessitating the use of new measures for testing its ef f ectivenesg 
in the community. . ' 

Hirsch, Felix E., ed, " Introductioni Why Do We Need Standards?" "*Stan-- 
dards for Libraries," Library Trends , 21(0ctober 1972), 

Mr. Hirsch defines standard and guideline. 

The existence of standards have brought about an improvement in 
opportunities for all libraries, 

"How to Test Your Library," Library Associa t ion Record , 72(Pebruary l97o) , 
49-52. 

This is an article reprinted from What ? and represents an outaj^^^ 
view of library services. It details what the average user shoul^ 
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able to* expect from a public library in the following areas s (1) 
si^ending on books, (2) reference books, (3) how many libraries,. (4) 
staff, and (5) what to look for in a library (hours, circulation 
policies, etc, ) . The article also reports the results of a question- 
naire completed by 38 libraries in England* All of the libraries 
were rated on their distance, hours, reference books, readers advice, 
staff and cost, 

Humphreys, K. W, "Standards for Libraries in Great Britain," Library 
^gnds, 21(0ctober 1972), 312--29, 

Libraries in Great Britain have been organized into the British 
Library. The various kinds of libraries and the bodies with whom 
they are affiliated are discussed. An awareness of the difficulty 
of writing standards is indicated, with some of the quantitative mea- 
sures for various kinds of libraries included* 

Illinois Library Association* public Library Sectioh, "Measure of 

Quality^ Standards for Public Library Service in Illinois." Illinois 
Libraries, 54(Pebruary 1972) , 131-46. 

: Recognizing the need for statewide standards, both quantitative 
and qualitative, the Public Library Section of the Illinois Library 
Association attempted to list the minimuiri facilities and the services 
which any citizen might logically expect when he utilizes the ser- 
vices of the public library* The committee's recommendations, which 
are followed by standards, were not developed for branch libraries, 
bookmobiles, library systems headquarters, or other such units* 

Jain, A, K* "Sampling and Data Collection Methods for a Book Use' Study," 
Library Quarterly , 39(July 1969), 245'-52* 

The purpose of this article was to describe the methods of sam«- 
pling and data collection for a book-usage study in a research li^ 
brary. Various methods of sampling usually used were described, and 
then the author * s method of measuring "relative use" was described. 
The relative use method involves the sampling of the total collection, 
the sampling of check-outs for home use, and the sampling of in^ 
library use* The author concludes that the relative use method gives 
more precise estimates than the collection method. 

Jain, A. K. "Sampling and Short Period Usage in the Purdue Library." 
C ollege and Research Libraries , 27(May 19S6), 211-18* 

Several possible methods of sampling the social science monograph 
titles in the general library of Purdue University were considered, 
and the "relative usage" method was used to obtain estimates of their 
usage in the library and at home for a five-week period* Relative 
usage was used to study the effect of language, country of publication, 
year of publication, and year of accession of a monograph title. 
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A questionnaire was employed to study the usage of library 
facilities and to gather opinions of library patrons. Purpose of 
.visiting the library^ reason for checkout of library material, rea- 
son for preferring library or home use of library material/ etc, , 
were analyzed on the basis of the replies received. 

Jones ^ Arthur, -'Criteria^ for the Evaluation of .Public Library Services," 
Journal , of L ibrarian ship, 2{0ctober 1970), 228--45, 

The author argues that the evaluation of public library services 
must be based on a clear conception of objectives, A list of objec- 
tives and questions to be answered about each are suggested. He 
also notes that the provision of resources can most easily be quanti-- 
fied and evaluated statistically and then be compared with standards, 
and norms. These are tabulated for a nuntoer of aspects of public \ 
library service; buildings, mobile libraries, expenditures, book 
stocks, and book purchases, 

"A notable omission is the whole complex question of the evaluation 
of 'output,*" The author still hopes/ however, that the paper may 
assist librarians in the evaluation of their own libraries. 

Kaiser, Walter H, "Statistical Trends of Large Public Libraries, 1900- 
1946." Library Quarterly, ISCOctober 1948), 275^81,* 

A summary of selective data reported by large public libraries in 
the United States from 1900-1946, Figures are presented on circula- 
tion, expenditures, volumes per capita, average population, book 
stock, expenditure per volume circulated, per cent of total population 
registered as borrowers, circulation of books per borrower* per cent 
of juvenile circulation of total circulation, percentage distribution 
of expenditures, average nuniier of branches and subbranches, level of 
American business activity, and school eKpenditures . The author notes 
that an adequate program for collecting and reporting statistics is 
needed, 

Krikelas, James. "Library Statistics and the Measurement of Library 
Services," ALA Bulletin , 60 (May 1966), 494-9* 

The article opens with a br^ief look at the history of library 
statistics and the measurement of library services. The author note^ 
that the attempts to establish a uniform statistical report form for 
all types of libraries were never fully successful , 

He argues that it is more important to inquire into the nature of 
library service to determine what measurements have meaning than to 
attempt to give meaning to the measurements that are currently being 
undertakenp 

The author concludes that no obvious measureinents can be made to 
determine how effective the library is in providing the services neces- 
sary to meat its objectives, and there is no obvious way of applying 
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uniform measurements to libraries which are serving diverse objec- - 
tives* But regularly Gompiled^data and the publication of descrlp'= 
tive statistics can be. useful for , indicating national trends, as a 
^ rough indication of library activity, and within limits, as a basis 
of comparison of libraries. 

LShmann, Otto* "Efforts for international Standardigation in Libraries," 
Library Trends, 21(0ctober 1972), 330-53, 

Cooperation can be attained only through the implementation of 
standards. While there is great diversity within each country there 
is an even greater diversity among them. The author describes the 
work, being done thru IPLA to facilitate standardization and the impact 
of technology in libraries throughout the world. 

State library statistics are the most important instrument for 
directing and managing libraries. Since 1932 IPLA has attempted to 
work out comparable international library statistics depending on uni- 
form principles, such as standardization of terminology. Standardiza-- 
tion is necessary because of electronic data prOGessing machines in 
libraries. 

The Lonq-Ranqe Plan of the Michigan Department of Education for Library 
Services throughout the State . Michigan State Department of Educa- 
tion, Lansing. Bureau of Library Services, 1972, ED 070 486 

The State Library Program for future services to the citizens of 
Michigan includesi (1) a discussion of premises on which the plan is 
based* (2) the plan with its goals, objectives, and implementation 
strategies; (3) a description of the existing delivery system within 
the State Library; (4) a discussion of the evaluation procedures to 
measure library services and ^ programs (including output and per for-- 
mance measures) ; and (5) an appendix of data, survey, charts, and 
publications which reinforces, supports and/or more fully illustrates 
the plan. Structurally, the plan orients itself around four broad 
goals. Under each goal, numerous objectives are delineated to insure 
complete coverage in every possible area, and implementation strate- 
gies are listed which, when implemented, will successfully achieve 
the appropriate objectives and broad goals. 

Long-Range Program, Hawaii State Library Systems- 1973-1978 , Hawaii State 
Department of Education, Honolulu. Office of Library Services, 
ED 069 319 

This program is based on and is a continuation of the needs assess- 
. ment as listed in the Booz, Allen, Hamilton study of Hawaiian libraries 
which also provided a basis for systematic library planning in Hawaii, 
It describes the operation of the Office of Library services. Geo-- 
graphical setting and political and economic characteristics of the 
state are described with implications for the growth of Hawaiian 
libraries. 
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The program includea a statement of the measuring of the effee-- 
tivenesB of library services* It provides for planning of evaluatipn, : 
so that data received can be utilized In the modification of existing 
plans and development of new programs* . 

Full statements of plans for LSCA Title II, and' III funding 
are given and explained. A part of Hawaii ' s future lies in ^j^g-^ ™ 
federal granting of the money for these long--range and well--generated 
plans for Hawaii's information network* ' 

McDonough^ Roger H* and David C. Palmer, " Standards for State Libraries,". 
Library Trends / 21(0ctober 1972), 178^89. ■ " 

LSCA funds forced the development of state, library standards*; 
The libraries in each of the states vary widely in administration^ 
in function- and in purpose. Standards are 'directed at the functions ^. 
performed by the state agencies. State librkry. standards are really 
criteria or guidelinesj there is no such thing as a standard state 
library, 

Maizell^ R. "Standards for Measuring the Effectiveness of Technical 

Library Performance," Institute of Radio Engineers Transactions on 
Engineering Management EM--7 , I960, p, 69-72 » 

In this paper established criteria are reviewed and new criteria 
are proposed in ord ^r to evaluate the performance of the technical - 
library. Evaluation is desirable because of the increasing expen-- 
siveness of library prog rams * and because it couldibe the basis for 
administrative and budgetary decisions. The author proposes a five 
point evaluating program consisting of (1) developing norms with 
which a comparison can be made; (2) evaluation of the journal and 
book collection; (3) study of the effectiveness of the reference ser- 
vices; (4) development of an index of effectiveness defined as the 
ratio of material used to material demanded; and (5) determining the 
impacts of the library and its personnel on the research program and 
personhel. This last point, according to the author, is the most 
important single factor in evaluation. For if the library can effec^ 
tively meet requests for materials and information^ save laboratory 
funds and contribute to the solution of difficult research problems, 
then it becomes an indispensible tool for the researchers. Unfortu- 
nately, this criterion is most difficult to evaluate^ but extensive 
interviews and observations are the suggestions made to help ease 
this problem. 

Martin, Allie Beth, A Strategy for Public Library Chanqeg Proposed 

Public Library Goals-Feasibilitv Study . chicagoi American Library 
Association, 1972. 

The purpose of the Goals-Feasibility Study is to answer the ques-- 
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tion "what Is the state of the library today and what should it be in 
the last quarter of this century?'' First, problems of the library 
were identif ied-^f or instance, new patterns of service are needed to 
meet the needs of the aging, disadvantaged, handicapped, etc.; new 
ways of serving rural populations are neededi the 'intialance in library 
support between city and suburb needs to be rectified and new tech-- 
niques are needed to speed Information to users. In order to find 
answers to these problems, questionnaires were sent to librarians, 
library leaders, salected non-librar ians, and 60 libraries in the 
original Public Library Inquiry, The librarians responses were con^ 
ceirned with three major goals of the libraryi (1) to provide serviee 
to ali# (2) provide information services, and (3) provide adult con^ 
tinuing education. Important goals for the next decade for libraries 
include this four part plan of actions (1) A publication and a doc^ 
umentary film is needed to focus attention on the public library as 
an active community agency meeting the real needs of the people. (2) 
Research is needed for knowledge of more effective performance. (3) 
Widespread coordination and dissemination of the knowledge found 
throi^gh research is needed and real-life applications need to be 
developed. (4) Librarian's education needs to be continued and an 
intensive educational effort made in library schools themselves, 

Martin, Lowell A, Library Response to Urban Change . Chicagoi American 
Library Association, 1969. 

This project is the third in a series of studies of the Chicago 
Public Library^ ^ It proposes the keyword of "adaptability" as the 
library's byword for its future in the city- In order to attain 
"adaptability," the study proposes internal reforms /and new goals to 
enable the library to reach its full potential in serving the changing 
needs of Chicagoans. 

The author does not rely on his evaluation alone, but calls in 
experts to help analyze the library and make recommendations for its 
improvement. Innovative techniques were used in this analysis which 
took a little more than a year to accomplish, a thorough study 
(statistical) was made of the people, their incomes^ life style and 
population distributions in this metropolitan area. User studies 
were performed* branch libraries were visited and studied, the main 
building was analysed, its collection evaluated, staff surveys were 
conducted, financing and administration was investigated. The re- 
sulting report presents reasonable, practical, well'-researched and , 
documented conclusions and reconunendations (for a plan) for CPL 
through 1980. 

Martin, Lowell A. "Standards for Public Libraries." Library Trends , 
21(0ctober. 1972) , 164'-77. 

The National Standards of 1933, 1943, 1956 and 1966 are discussed. 
The early standards relate to individual libraries and the later ones 
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to cooperating groups of libraries* In 1956, budget became a deter^ 
mining indicator. 

For the future, standards should be developed that rest upon 
fresh concepts suited to the conditions which have emerged at the 
time they are issued. in shorty libraries are dynarnlo institutions 
and the reports issued should reflect this. "Useful standards can. 
. be forrtiulated* reasonable measures of achievement can be devised, if 
one knows what they are being devised for," 

Mathematica , . On Li brary Statist ics, Submitte d to the Na tional^dyisory 
OoiOTiss^ion on Libraries . U. S. Office of EduGation* Bureau of 
ResearGh, 1967. 

\ 

Recent, accurate statistical data for libraries is to be found 
only for college and university libraries. This report suggests that 
reliable, information on libraries which "are an impo^ta^nt element in 
the nation' s educational^ cultural and research equiprnent" is a. high 
priority. They suggest a systematic approach to the collection of 
the right kinds of statistical data needed for rational planning and 
decision-^making . A centralized data collection point* e*g* the .Fed- 
eral Government* is the most efficient means to the gcs^]^ of good 
quality data. They make three suggestions for the est^blislOTent of 
this kind of data for librarians i (1) A publication be established- 
which v;ould be an annual compendium of library statist i^g^ Engage a 
permanent staff to specialize in these statistics; stai^jjardi^e the 
report format so that users. can become familiar with it^ (2) Select 
a sample of libraries whose statistics can be relied ^ti^ and Use 
these annually. Design the sample to include all si^es and types 
of libraries, (3) Collect data which can measure cu^J^ent capacity 
of library buildings and reveal the rate at which reserve space is 
exhausted. This is essential for rational planning o£ capital con- 
struction for libraries. 

Mikhailov, A, I., ed. Problems of information User Needg ^ ED 081 456 

This volume's thesis is to "include articles that Qould reflect 
the wide range of problems dealing with informat^Von n^eds and dif- 
ferent practical approaches to their solution*" The first article 
takes a historical approach to the development of scientific infor- 
mation activities as a whole and to the interaction between the in-- 
formation generative process and, its organization for ^se* The 
author feels that social demand for information and us©r needs have 
played a decisive role in the development of information activities. 

The third author's concern is "Information Systems and Informa-- 
tion Users." Here are raised some interesting and important problems 
concerning information systems^ such as the importancs of forecasting 
the developmant of information requirements and designing appropriate 
models. 
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Another article discusses meeting user needs with the aid of 
S*D,I* systems, and the final paper is based on research done at 
two Cracow higher school libraries on information user needs ^ The 
authors recommend that librarians should be acquainted with the 
educational process ^ and cooperate with the teaching staff so that 
they might obtain a better understanding of the reference needs of 
the students, 

Millett, John D, Management in the Public Servlceg the Quest for Ef - 
fec t ive Per formance. New Yorki - McGraw-'Hill, 1954, 

The author has presented a wide variety of problems which must 
be solved in order to achieve effective perforinance in the public 
service* He does not agree that an organization eKists in and of 
itself; rather he proposes that unless an organization cohtrlbutes 
to fulfi.lling some basic public service to a large majority of the 
citizenry^ then there is no justifiable excuse for the organization' 
existence. Effective performance is a much to be de sired foSr^aM 
in order to realize this goal certain qualities must be apparenti 
satisfactory service^ responsible performance, and good government. 
The author realizes that the above three qualities or values must 
be discussed, modified and interpreted to fit various conditions^ 
but without them management In the public service has no meaning* 

Morse, Philip M. ''Library Models * " ^ A* W* Drake, R* L. Kenhey and 
P, M* Morse, Analysis of Public Systems , Cambridge, Massachusetts! 
MIT Press, 1972, p. 235^56* 

The current problems of the economy have caused many financial 
worries for libraries and has necessitated a change in their deci-^ 
slon-'making policies* The author of this article feels strongly 
that library administrators must analyze library operations quanti- 
tatively and devise models to represent and predict their behavior* 
The best models, according to Morse, are those which are easy to 
utilize and require the least amount of manhours to collect the data 
He suggests using circulation figures or book card analysis as input 
for the first models designs* These would be implemented by taking 
small random samples at regular intervals and inserting this data 
into the formula of the model* The results should provide useful 
means of evaluating a library's performance, thus making it easier 
for the administrators to evaluate the performance of new policies 
and revise their plana in aGCordance to this performance. 

Murray, Florence B. "Canadian Library Standards." Library Trends ^ 
21(0ctober 1972), 298'-311. 

Changes in governing bodies in Canada in the 1950 *s have been 
parallelled by changes in the structure and goals of the libraries. 
The standards issued in 1967 are written in qualitative rather than 
quantitative terms. Library systems have evolved into a rudimentary 
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network, Canadian librarians are aware of what is happening in the 
U* S.* but write standards to meet their specific goals and needs. 

National Center for Education Statistics, Statist ics of Public L ibraries 
Serving Areas with at Least 25^000 Inhabitants^ 1968^ Government 
Printing Office, 1970. * 

This survey is one of the series of selected statistical data for 
public libraries collected by the United States Office of Education 
since 1944, The basic reporting unit considerad here is the " indepen- 
dent, locally automonous library as an independent unit," Therefore/ 
piA)lic library systems are not included^ and the areas served by the 
public libraries must have at least 25,000 inhabitants to be in this 
survey* The report itself is based on two questionnaires given by 
USOE and covers 1,057 libraries in 49 states. (Georgia did not par- 
ticipata';) Tables included in this report arei population served, 
operating expenditures, operating receipts by source, salaries, li^ 
brary staff, maintenance staff, SMSA area, book stock and circulation 
record* Also included in the report is the actual questionnaires 
and instructions. 

National Commission for Libraries and Information Science, A National 
Proqram of Library and Information S ervice, 1974* 

This is a policy statement regarding libraries and the informa-- 
tion industry of the nation and their relations with ultimate users 
of knowledge resources and information* It states repeatedly the 
need for a network so that all citizens may have access to informa- 
tion regardless of mode of eKpression or repository. 

Functions and relationships of all segments of the information 
community should be studied and integratedi libraries, publishers, 
indexing/abstracting services, education"Commercial--government 
agencies, and information industry. More needs to be' done to under- 
stand the information needs of various special constituencies in the 
U. S* 

Newhousa, Joseph P, and Arthur J. Alexander. An Economic Analysis of 

Public Library Services , Santa Monica, Californiai Rand Corporation, 
1972/ 

Two economists attempt to develop a methodology for answering 
some problems that public libraries face. With the cooparatlon of 
the staff of the Beverly Hills, California, Public Library, the prob- 
lems of allocation of book budget, collection development, cost 
studies of circulation systems and security systems are all analyEed 
by their methodology (user and community surveys) , 

They discover that the cost/benefit ratio differs among various 
clashes of books* The books with high cost/benefit ratios in this 
library are mysteries, preschool and young adult fiction, and pay- 
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chology books* They suggest, at the judgment of the librarian, that 
the book budget be increased in these areas to benefit the cominunity. 

They discover that households with children in this community 
use the library the most. And that a two week book checkout period 
increases the satisfaction in finding books in the library to 2/3* 
The method they use to determine the cost of reference services is 
easy to obtain^ and they suggest it should be collected regularly. 
They suggest many ways librarians can study their own special prob-- 
lems and provide clear alternatives to consider. 

Nie, Norman, Dale H. Brent and C. Hadlal Hull,* SPSSi Statistical Pack - 
age for the Social Sciences , . New York* McGraw^-Hilli 1970^ 

This manual is a complete Instructional guide to statistical 
packages for the social sciences (SPSS) , This computer package 
program was designed so that the social scientist researcher could, 
through use of SPSS, manipulate and analyze his data easily. Page 
viii of the introduction to this manual explains SPSS as "an inte- 
grated system of statistical programs entoedded in a series of common 
procedures for management and handling of complex data files,*' 
Through use of natural-slanguage control statement, a researcher with 
no previous programming knowledge cari perform complex analysis such 
as partial correlations, multiple regressions, factor analysis, etc, 
on his data. The language used for SPSS is Fortran IV, an almost 
universal language in the computer world. This and the fact that 
the two computers SPSS was developed on (IBM 360 and CDC 6000) are 
in wide use in most universities, will hopefully result in the long 
life of the SPSS package in research communities. 

O'Neill, Edward T. "Sampling University Library Collections." College 
and Research Libr aries, 27(Novembar 1966), 450-4. 

A description is given of two simple random location sampling 
techniques to be used in large library collections. The first is 
based on the actual location of a bookj the second used the shelf 
list. Both methods involve numbering. The first takes all possible 
locations where books may be found and then systematically numbers 
themr the sample is then drawn easily from the nuntoer locations. 
The second technique first nuntoers all of the shelf list cards and 
then samples them. The sampling system found most efficient and 
which involved the least amount of hours was the location samplings 
the shelf list sampling, based on the experience reported at Purdue 
University Library, was recommended for use only in special circum- 
stances , 



Oregon, 1972. ED 069 300 

h plan to conduct user surveys and to investigate non^-uaere is 
presGnted^ 
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Orne, Jirrold, "Standards in Library Technology." Li btary Trends , 
2l(0ctober 1972), 286-97, 

The author discusses the background of the. American National 
Standards Instituta/ConuTiittee Z39 {ANSI/Z39) , which deals with 
"Standards in the fields of library work, documentation and related 
publlshing^^ractices, " and discusses how the committee works, 
ANSI/Z39 has iss\ied a number of standards related to library tech- 
nology* 

Parker, E. and W. J. Paisley, "Predicting Library Circulation from 
Community Characteristics," Public Opinion Quarterly / 29 (Spring 
1965) , 39^53, 

The authors obtained the basic data for this study from the USOE 
1956 survey of library circulation and from Markat Statistics Incor-- 
porated* 1957, Data important to this study of use of libraries and 
books in the "television era" arei median education of males and 
females, median age in a given county, per cent white residents, per 
cent urbanization, per capita retail sales and buying income, mean 
family size, and per cent TV saturation. 

Libraries were classed into ten types to account for their dif- 
ferences and as a control factor and then the above figures were 
studied for correlations, Among the 'more interesting findings arei 
(1) high correlation between circulation figures, female educational 
level, the area's population, and income* (2) significant relation- 
ship between population and circulation of fiction; and (3) signifi-* 
cant relationship between income level and non^-flction use for non- 
fiction holdings and circulation increase per capita as population 
Increases, 

The authors feel that there is a definite problem of book stocks 
of libraries shaping the demand structure of a community. Non-fic- 
tion collections are less than adequate if population and Income 
determine the circulation rats and certainly more research is needed 
in this area of library studies, 

Penna, C, V, "Library Inspection." UNESCO Bu lletin for Libraries ^ 
23( July 1969) , 170-7, 

This article attempts to respond to rhe points raised by experts 
at the Antiqua Conference (Meeting of Experts on the Development of 
School Libraries in Central America--29 July to 2 August 1968,) The 
necessity of library inspections and constant evaluations are the 
topics of diecuesion here. The author feels that the main cause of 
failure of the best plan of library service improvement and expansion 
could be from lack of inspection. Inspection must relate to both the 
user of the library and the socl-il institution to which the uBsr be- 
longs^ For if the user understimds library policyi the mathods in 
usa at the library # and the ser^dce provldad^ than he can make sug- 
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gestions for that library inspector* He is the liason between the 
library and the authorities* He keeps up to date with new research 
ideas^ he briefs librarians on innovations^ trains them and sees 
that upkeep of materials and equipment is iDroperly maintained. An 
inspector should be a highly comx^etent, well-read individual with 
leadership qualities and most especially^ specially trained to be an , 
inspector* 

Library inspectors are an important link in the process of exten- 
sion of library services by state grants* If this money is to be 
well spent, then numerous well-trained inspectors are the answer* 

Pings, Vern M* "Development of Quantitative Assessment of Medical Li^ 
braries*" Colleqe a nd Research Libraries , 29 (Septerrber 1968)^ 
373-80. ) 

This* is a summary report of a project supported by the National 
Library of Medicine to try to define methods that would help to 
evaluate the national biomedical complex as a system. Since it was 
not possilbe to study this system as a whole, the approach of a user 
of the library's services was consideredv^^ vThe question to be an- 
swered was "as a user of this library, what is the probability of 
obtaining a document or citation I want in a certain amount of time*" 

A methodology that is applicable to all biomedical libraries 
was developed* It must be easy enough for the" staff of each library 
to perform, and the results must have meaning to users, librarians 
and administrators* 

Methods for testing an academic research me^dical library's 
ability to provide document delivery to its patrons, simple fact 
answers and document delivery by interlibrary loan, and to verify 
and correct citations for its clientele are presented, 

A random alarm device was developed which can be used to gather 
statistics randomly* Many uses are forseen for this method* 

Pinzelik, Barbara P* Statistical Collection Simplified Within the Purdue 
General Library * Part I* ED 068 112 

The purpose of this report is to simplify the gathering of sta-- ' 
tistics at Purdue University Library and determine if there is some 
relationship between two sets of time--consumlng statistics gathered 
since 1934 at the library. The daily counts for both materials 
checked out for home use and materials used within the library were 
statistically compared for the years 1966-1971, The findings showed 
a high correlation between the two sets of figures, meaning that 
home use materials could predict library use materials* The study 
recoiratiends eliminating the time-^consuming tabulation by the pages 
of books left on tables, etc, within the library, thus saving Purdue 
$4,500 annually and fraeing the book shelvers for other tasks. 
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Poole, Prazier G. "Parformanca Standards and Specifications in the 
Library Economy,'* Library Trends^ ll(April 1963)^ 436-44, 

\flien there is a dGfinitQ need for library performance standards, ' 
one should check the contributions of the Library Technology Pro- 
ject* Since librarians are consumers, carefully devGloped perfor- 
mance standards can help them make better, more economical purchases 
of library equipment and supplies. 

The article traces the history of library standards and then dis-- 
cusses the time, effort, expense and cooperation necessary to develop 
an effective standard. After the standard is tested, it must be 
agreed upon by an "authority,'' either a national professional associ- 
ation, technical society or manufacturer. Effective use of these 
performance standards result in (1) healthy competition, reducing 
the price of the goods and (2) Improvement in tlie quality of tha 
goods. Both res^.lts are favorable for the consumer-librarian. 

Pritchard, Alan and others. Library Effect i veness Study ^ May 1973, 
ED 089 761 

This is an investigation of user demands, satisfaction and the 
kinds of services provided at four libraries. Statistics were col- 
lected on the usage of the library by various groups and on the 
usage of various materials. The users in this study were the stu^ 
dents and faculty* 



Measured were: Items used per time period. 

Total population possible. 
Total number using the library, ^ 

Ques tionnairai Niimber of questions asked. 

Number of satisfactory answers supplied. 
Users who did not ask questions but used the 11-- 
brary as a study or for social purposes or 
other. 



Raff el, Jeffrey and Robert Shishko. Systematic Analysis of Univer sity 
Lib raries^ an App lication of Cost-Benefit Analysis to the M,I.T, 
Li braries . Cairtoridge, Massachusetts i M.I.T. Press, 1969. 

In the forward to this volume, Fred Charles Ikle credits the 
authors with the first use of a cost-benefit analysis in a univer- 
sity library. The first step taken in this analysis is to outline 
the mission of the M.I,T, libraries which are to provide material 
for course work and to support research. The problem then is how 
to organise future library resources into a set of programs that 
best fulfill the above objectives. Part of the solution is to be 
found in drawing up a program budget for the M,I,T, libraries. Here, 
when outputs are related to inputs, it becomes possible to identify 
trads-'Offs between program activities. For Instance, M,I,T, spends 
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as much money cataloging books as buying them. Is there another 
answer to this exiDenditure? 

All the budget inputs are studied in turn for viable alterna- 
tives, and then a user survey is constructed which asks the parbic- 
ipants to pick and choose among various hypothetical budget cate- 
gories the services they would most like to see in their library 
and the services they would alter or do without » 

The survey of the faculty and students^ since it provided them 
with alternatives, inay provide new insights into the preferences of 
these groups. The results of a systems-analysis are given^ including 
use of survey research^ jDrogram budget and user surveys. This pro- 
vided useful and usable information to the decision-makers at the 
M*I,T. libraries. 

Rather, John Carson and Nathan M, Cohen, St a tistic s o f Lib rariesi mi 
Annotates Bibliog raphy of Recurring Surveys , Washington, DC: U,S. 
Office of Education, 1961, 

This bibliography is a detailed index of sources of library 
statistics. The editors foresaw a need for the easier accessibility 
of statistical material to librarians, administrators, and the pub^ 
lie in making evaluations, i^l^^^i^S research, and measuring the per- 
formance of libraries^ so this annotated bibliography was prepared. 
The 156 citations given here are divided into two parts. First 
come the national and regional citations* then the state. All of 
the primary data is given for each citation, and the frequency of 
publication is noted. This bibliography does not give annual re^ 
ports or sources which only cover one library. It, instead, tries 
to identify large sources of library data and looks to the future 
for more publications in the same area. 

This publication reveals the paucity of library statistics in 
some fields, and the difficulty of locating and identifying other 
sources. However, the purpose of this volume is to bring researchers 
and librarians closer to the available sources of library statistics 
and make their bibliographic task a bit easier. 

Report on Library User Survey, 1974 , St, Petersburg, Florida: Manage- 




ment Improvement Department, 1974, 

In 1974 the City of St, Petersburg conducted a two-part survey 
of their library system to measure the effectiveness of public ser- 
vices, A survey of usage of facilities, circulation/ title avails 
ability, patterns of reference use, scheduling of public service 
personnel and user characteristics comprised one part. The other 
part was a questionnaire which was given to 663 library patrons, 
Methodology and results are given, 

Rockwood, Charles E. and Ruth H, Rockwood, Quantitative Guides to Public 
Library Operation , Illinois. University, Graduate School of Li- 
brary Science, Occasional Paper No. 89, 1967, 
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This article invGstigatGs five mGasurGs--population served, size 
of staff, volumes, circulation, and total lDudgGt'--in an effort to 
find a reliable guide of comparison between libraries. 

The study concludes that budget seems to be the most reliable ba^ 
sis for measurtsment ^ but j^oints out that public libraries vary tre- 
mcandously in the amount of money they have to spend as well as the 
way in which they spend it. The community environment also makes a 
big difference. 

The authors indicate the measures are inadequate for measuring 
or comi^aring the very largest libraries such as New York Public and 
Chicago Public. The measures may also not be an indicator for very 
small libraries, that is, th^se serving populations of 35,000 or less. 
Here they found they had too little information to draw a conclusion. 

This study, the authors felt, was in the nature of a preliminary 
investigation of the problem; "statistical refinement of available 
data on public library operations is so inadequate that much mora 
needs to be done before one even knows what statistical questions are 
. the right ones to ask." 

Rogers, Rutherford B. "Measurement and Evaluation," L ibrar y Trends , 
3(October 1954), , 

This article details shortcomings of circulation and reference 
statistics as a means of evaluating library service. It concludes 
with a hope that statistical methods being developed may overcome 
some of these shortcomings. 

Rosenberg, Kenyon C. "Evaluation of an Industrial Library," Special 
* Libraries, 60(DeceiTtoer 1969), 635^8, 

Rosenberg believes libraries, especially those in Special Li - 
brar ies with which he is familiar, need to come up with a dollar 
type of evaluation to justify their existence in a comparative way. 
He asks the question! "What is it that libraries are supposed to 
do?" He suggests that the usual statistics be kept, but that a 
weighted factor be added for the importance and valiae of the service. 
This would be obtained by user feedback. 

For a service, such as a literature search, reference question, 
bibliography, etc, a sample of the patrons would do an evaluation. 
How much time the task took is compared with how much time the task 
would have taken if the individual wanting the information had done 
it himself, 

The difference in time and the cost of the library's time vs. 
that of the patron is compared. Services can thus be evaluated in 
dollar terms. 

Rothstein, Samuel, "The Measurement and Evaluation of Reference Ser- 
vice.-' Library Trends , 12( January 1964), 456-72, 
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■ The prolDlGms In evaluating refGrGnce service are discussed; chief' 
among them is the problem of defining it, A nurnber of studies are 
categorized and evaluated briefly. An extensive bibliography accom- 
panies the article. 

Salverson^ Carol A. •'Relevance of Statistics to Library Evaluation*" 
College and Research Libraries ^ 30 (July 1969) , 352-^61* 

Statistics as now collected by libraries are static measurements. 
As such they are of little value in measuring either the effective^ 
ness or efficiency of the library. The concept of the library as a 
dynamic system is developed with suggestions for collecting statistics 
as a criteria for evaluation of that dynamism. A nurrtoer of provoca- 
tive questions are posed with a solution based on new statistical 
analytic tools being used for their resolution* 

Schick^ Prank L* "Coordinated Collection and Individual Use of Library 
Statistics," Library Trends , 13 (July 1964), 117^25. 

A brief history of the use of statistics is givenp Schick argues 
for standards and compatibility in statistics* As systems and net- 
works develop, it is necessary that statistics be comparable. Regard- 
ing performance measures, he says, "Measuring of performance is most 
difficult because 'use' questions concerning circulation, registration 
of borrowers, or the answering of reference questions are considered 
increasingly inadequate yardsticks j they are still used because better 
use indexes have remained unexplored," 

Schick, Frank L, "The Evaluation of Library Resources by Standards and 
Statistics," In National Inventory of Library Needs , Chicagos 
American Library Association, 1965, 

ALA standards are used as the measure for evaluation of needs* 
Statistics were compiled by questionnaire. The standards were com= 
pared with actual practice and the growth was charted over a period 
starting with 1960, Future needs were projected, 

Sewell, P, H* "Evaluation of Library Services in Depth*" UNESCO B ulle- 
tin for Libraries , 2 2 (November/Decer&er 1968) , 274-80, 

This was written for libraries as a guide for evaluating library 
service. Objectives are set and standards are used as a guideline 
to measure the objectives* 

Static types of statistics are needed even though they give only 
a crude indication of efficiency. To evaluate it is necessary to 
look for significant links between different sets of figures and 
supplement the data by on-the-spot observation and analysis. It 
suggests using statistics of the collection--'-ratio of books owned to 
books circulated (preferably by type) , 
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Slarnscka, Vladimiif, *'A Selective Bibliography on Library Operations 
ResGarch." Library Quartarly, 42(January 1972), 152-^8* 

The bibliography covers the us© of the scientific method to solve 
managQment problems over the period 1955-1970* Four categories are 
listed: general^ mathematical programming^ modeling and systems 
analysis. 

"Standards for Reference Service in Public Libraries," Library Associ- 
ation Record , 72(February 1970), 53-7* 

The present standards for volumes added per year, area, shelf 
capacity and seating are listed* Standards for reference services 
\ material (nature) , organization, staff (qualification, experience, 
; salary), and means (collection, telephone. Telex, photocopying) are 
proposed , 

The 'appendix lists standards for four types of libraries and 
population served: A-^-over 300,000; B—100,000 - 300,000; C-^-40,Q00 
- 100,000; — under 40,000* 

Tauber, Maurice P. and Irlene Roemer Stephens, eds. Library Surveys . 

New Yorki Columbia University Press, 1967, (Conference on Library 
Surveys, Coluittoia University, 1965,) 

This was a general conference on all aspects of surveys in pub- 
lic, school, state, special and academic Mbraries * Part One relates 
use of the survey method and various areas^ of service; Part Two 
covers special approaches and problems* 

Tauber, Maurice F* "Survey Method in Approaching Library Problems*" 
Library Trends , 13(July 1964), 15-30, 

The extent of library surveys is discussed and divided into four 
categories I nature of the survey method, approaches of the survey, 
limitations of surveys, and results of the survey approach. Surveys 
analyze eKisting conditions, implementation of their findings de- 
termines their effectiveness* 

Thompson, John I, Criteria for Evaluating the Effectiveness of Library 
Operations and Services , 1967^68. 3v, (ATLIS reports nos* 10, 19, 
21) * Washington, NTIS. 

The purpose of this study was to develop criteria for evaluating 
technical library operations and services, covering technical ser^ 
vices and user services. Part One is a literature search covering 
all facets of library management and services. Most of the bibliog- 
raphy is concerned with standards and the state-of --the-'art . 

Vol. 1 is general. 

Vol, II is directed towards the Army Technical Libraries, to 
establish criteria to .evaluate their operations and services. 
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Vol. Ill lists four techniques for evaluating technical li- 
braries-'-all are concerned with procedures and cost effectiveness 
and while useful for management purposes, they do not evaluate qua!-- 
ities of service to the putolic served* Evaluation is in terms of 
time spent in various operations and is related to cost. It is use-- 
ful in finding out how the staff spends its time and how long a task 
may take. It does not seem to be readily applicable to public li- 
braries. 

# 

Thompson, Lawrence S. "History of the Measurement of Library Service," 
Library Quarterly, 21(April 1951), 94-106. 

Early statistics related only to holdings. By the turn of the 
century scholars were asking about the nature of the collection and 
service. Once it was accepted that' items be qounted, it was then 
necessary to establish standards. This movement was well under v;ay 
when the article was written. 

The article concerns the history of all libraries in all countries* 
The German-speaking countries were the most statistically or number 
orientated. French^ English and American libraries in this survey 
are also discussed, 

Trezza, A. F, and James Beasley, eds. National Confe rence on Library 
Statist ics, 1966 , Chicago i American Library Association, 1967* 

This conference was held in order to impress upon librarians the 
importance of having sound statistical backing for their library. 
Statistics are needed to give support to legislation asking for more 
library aid; positive statistics are needed to show how federal 
grants actually helped libraries in the past. The last point is im- 
portant because there is a distinct possibility of federal money 
becoming tight in the future, 'If libraries can prove that their 
goals are in conjunction with other educational institutions that 
benefit society at large, then this can only improve their case for 
more federal monies. Also, for state and local financial support, 
librarians must be aware of the impdrtance of sound figures to make 
local officials aware of library needs, A librarian, therefore, 
needs a wide range of skills in management, information transfer, 
communication, etc., in order to accomplish these objectives. The 
appointment of a National Advisory Committee on Library statistics 
was recommended to work on a national plan to accomplish the goals 
discussed at this conference , 

Trueswell, Richard W, "A Quantitative Measure of User Circulation Re- 
quirements and Its Possible Effect on Stack Thinning and Multiple 
Copy Determination," American Documentation , 16 (January 1965) , aO-^S. 

Using last circulation date, a method is given for keeping the 
active collection size manageable and useful. The article is also 
concerned with the need for multiple copies of heavily used materials'. 
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Trueswell^ Richard W* "Some Behavioral patterns of Library Users: The 
80/20 Rule." W i 1 so n _Llh r a r ^ B ii 1 1 Q tj^ , 43{ January 1969), 458^61* 

A characteristic of business is that 80 per cent of the trans- 
actions represent 20 iDer cent of the items stocl<ed. Does this hold 
true for libraries? The author finds that it does, leading to the 
suggestion that techniques used for managing business inventories 
are applicable to libraries. This pattern can have meaning in re- 
gard to weeding, core collection development and for determining 
what the users of a library are reading, 

Trueswell, Richard W, "User Circulation Satisfaction vs. Size of Holdings 
at Three Academic Libraries," College and Re search Libraries^ 
30{May 1969), 204-13. 

A method using date of last transaction as a parameter for de- 
fining and predicting library circulation patterns and building a 
core collection is described. 

Urquhart, J. A, and J, L, Schofleld. "Measuring Readers* Failure at the 
Shelf*" Journal of Docum entation, 27 (December 1971), 273-86, and 
28(September 1972), 233-41, 

The study outlines title availability failure in testing books 
known to be held by the library against their availability when 
desired by a reader. The methodology and results of the survey form 
the major portion of the paper. 

The primary cause of failure to locate the book was that it had 
already been borrowed. The same titles seem to be in demand by 
users regardless of level of study; undergrads# grads and faculty 
competed for the same works. 

(The second citation is a continuation of the work of the first 
in three other libraries.) 

Wallace^ James 0. "Two-Year College Library Standards." Library Trends , 
21(0ctQber 1972), 219-32. 

The problem of writing the standards for two-year colleges is 
bound in with the growth, diversity and multiplicity of the insti- 
tutions. Standards written in 1960 assisted in securing funds to 
improve collections and services. Since 1960 many changes have 
taken place requiring that new standards be written. The 1972 
draft does not have qualitative measures and are guidelines rather 
than standards, emphasizing programs* 

Warncke, Ruth. "Library Ob jectives and Community Needs." Library Trends ^ 
17( July 1968) , 6-13. 

The objectives of library service as seen by librarians has 
varied; during the period 1850-1890 the emphasis was on moral judg- 
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ment, in the period 1930-1950 vocational improvement bacamG a major 
goal, while community development became a major concern beginning 
in 1957. 

The collections developed and services offered reflect the li- 
brarians* concept of their objectives and goals. Libraries are be- 
coming more and more involved in their total community, working with 
and through groups to meet the needs of the wider community. 

Libraries are quality oriented^ and this is evident through the 
level of cultural event and materials they have collected and pro-- 
moted. Programs are now concerned with national problems^ seldom 
with the inmediate community* 

The objective of continuing education is revealed in only a 
limited way in some libraries. The educational work carried on is 
often based on uneKamined assumptions^ and analytic study is urged, 

Watkins, David "Standards for University Libraries." Library Trends ^ 

21(0ctober 1972), 190-203. 

There is no standard for university libraries. Several approaches 
have been made by ARL and ACRL* The library in a university should 
be viewed as an integral part of the university and standards drawn 
for one library will be different from that of another. The various 
regional accrediting bodies have different standards for the libraries 
in their jurisdictions. It may be that there should be several 
standards for universities of various sizes. 

Yast, Helen. ''Standards for Library Service in Institutions i in the 
Health Care Setting." Library Trends , 21(0ctober 1972), 267^85, 

The concern with standards in hospitals goes back to 1938. 
Health-care libraries include service to patients, staff and admini- 
stration. Quantitative standards were the most frequent type. In 
1970 the emphasis changed and quantitative criteria were eliminated; 
service was stressed. 
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North Suburban Library 
System Pilot Study 

One outgrowth of the performance measures study conducted by the 
Bureau of Library and Information Science Research at Rutgers Uni- 
versity and the 1973 ALA pre^-conf erence devoted to measurement tech-... 
niques was a pilot study using similar performance measures in the 
North Suburban Library System in Illinois, The system headquarters 
staff held a workshop in the spring of 1974 to describe the data 
collection techniques to the member librarians of the system. They 
were provided with manuals, user tickets, and worksheets to be used 
to collect data from their library patrons during a three--day period 
between May 6 and May 12, 

The performance measures manual. Manu al on the New Measures of 
Library Effectiveness , was based on the original manual prepared by 
Rutgers University, but it also included some modifications and 
additions. The user ticket employed by North Suburban was also its 
own version, but it was similar to the ones used by Rutgers and the 
Library Research Center at the University of Illinois, (See 
Appendix page 34 of the manual, for a copy of the user ticket 
employed by the Library Research Center,) 

Twenty-nine libraries participated in the pilot study, and they 
collected a total of 45,116 user tickets. In addition to the user 
characteristics, they collected data in the following categoriesi 
title availability, equipment and facilities usage, in-library cir-- 
culation, patterns of reference use, public service personnel and 
circulation analysis. 

In April 1974, William Larsen, information Librarian of the 
North Suburban Library System; Gerald Born, Executive Secretary of 
the Public Library Association; and Galen Rika, Research and Sta- 
tistics Specialist of the Illinois State Library met with staff 
members of the university of lirinois Library RGsearch Center. 
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The decision was mad© to contract the Research Center to assist the 
...NQ^th Suburban Library Sysfeem in the analysis of the user data and 
some of the performance measures data. 

Subsequently^ North Suburban sent all of its user tickets and 
summary data on in--library circulation^ outside circulation^ equip- 
ment and facilities average use per hour^ and equipment and facili- 
ties utilization percent to the Library Research Center, 

During 1974-75, the Research Center staff coded and input the 
user ticket data in order ^ to tabulate and summarize the data by 
cornputer. Reports were then prepared summarizing the user ticket 
data for all of the participating libraries. The libraries were 
divided into five budget categories, so there were five different 
"user characteristics" reports presenting results for libraries with 
similar total operating expenditures. Each report gave three-day 
means for the following user characteristics* patrons per day, sex, 
age, student status, grade level, occupation, residency, staff 
assistance, acquisition of desired materials, library service, and 
length of stay- The reports also included histograms for each li- 
brary giving the percent of patrons arriving and departing per hour. 

In addition, correlation matrices were provided which presented 
Pearson product - moment correlations for the relationships between 
several of the performance measures variables and^appropriate annual 
report data. One matriK gave correlations for all of the libraries 
in the study, treated as one large group. Five other matrices 
presented correlations for those same libraries divided into budget 
categories. Copies of the report and explanatory cover sheets were 
sent to the North Suburban Library System headquarters. 
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RUTGERS ■ 

THE STATE UjllVERSitY 
OP NEV/ JERSEY 



GRADUATE SCHOOL OF LIQRARV SERViCE-QUnEAU OF LIBRARY It INFORMAl ION SCIENCE RGSEAFICH 
189 COLLEGE AVENUG*NEW BRUNSWICK • NLW JEnSCV 08903»?0l/y32^7&0l 



March 17, 1975 



Mr, Galin Rika 
Illinois State Library 
201 Soiith Second Avenue 
Springfield p Illinois 62756 



pear Mr. Rikei 

At the request of Mr, Gerald Bornj I am hereby authorizing the use 
of P erfo rmance Moasu res for Public Libraries: A Procedures Hanual f or the 
Collection and Tabulation of Data (Octobers 3.974) in the Illinois *study. 
I understand you have been using the October version in training sessions 
across Illinois and plan to implement the full study in the near future* 

I must, again, retnind you and all other Tnerabers of the various 
groups involved in the "study that there are limitations both with the pro- 
cedures for collecting and tabulating the data and especially in the in- 
terpretation of the "numbers" that result from the implementation of the 
study. We have done considerable revision of the October" version and I am 
including a brief suinmary of the needed revisions as prepared by Ellen 
Connor Clark that refiect our experience ^wlth the first group of librar^ 
ies studied in New Jersey, Philip Clark raet with you on January 23 and at- 
tempted to counsel you on the problems of Implementation, the lltnits of 
data interprecation and tlie like, I have repeatedly stressed the llmlta-" 
tlons and dangers that are possible given this type of service meaourement. 
I remind you of them becauss of a recent experience we have encountered? 
namely* the unauthorised release of the collected data to a governmental 
official who is attempting to gather support fox the dissolution of one of 
our participating libraries* By using selected figures from his pirated 
copy, an unfortunate situation has occurred. 

Tliua, while I am releasing the use of the October manual to you for 
use in your present study, I also wish to be on record as having advised 
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you and raembers of the variouo InvolVGd parties that work and testing 
still goes on. The authors, having stated their reservations on the limits 
and potential dangers as well as the positive aspects of the study proce- 
dures must J at this time, be assured of your understanding of our position* 



Very sincerely. 




Ernest K* PePrcspo 
Professor 



End , 

cc; P. Clark 
E. Clark 
E* Altrnan 
G. Born 
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RUTGERS 

THE STATC UHlViiRSifV 
OFNEWJEnSEY 



GRAOUATE SCHOOL OF LJBRARy SiRVICi^SUnEAU OF LIBRARY & INFORMATION SCIFNCE RiSEAPCH 
iBg COLLEGi AVENUE. NEW BRUNSWICK • NiW JERSEY 08903*201/932^7961 ' HfeSBARw-M 



To: New Jersey MGasurement Team 
From! Ellen C. Clark 
Date! January 30^ 1975 

Rei Modifications madertfn the Procadures Manual as a result of Phase I 
of the New Jer^^' Measurement Study and feedback sessions 

\ 

1. BPR Probability Hpinple 

a. The number of title.s \rill be cut to SOO which will reduce th( 
L time and personnel involved in data collection but still ra« 
talm the validity of the sample, 

b* In the published manual^ instructions will be given for draw- 
ing a sample from LJ as a supplement to BPR, 

c. The use of BPR In small libraries is being reconsidered since 
the number of titles owned Is so small that further analysis 
is impossible i 

d. juvenile titles will be so indicated on the data collection 
form. 

e. Space will be provided for recording the Dewey number next to 

the titles owned, • 

. . ■* ' 

f* ^ Sin«^ so few libraries can '^^k thelr-t^jL^ files con-» 

venientlyj this aspect of tHe data collection will be elimin- 
ated from the fono and iricluded only asjjan additional area to 
be considered for those libraries that wou3d be willing and 
able to do so. 



2, Title Availability Sample 

■* . . 

a. More space will be provided on the data collection form to re- 
cord the title more completely. 

Determination of sample Interval will be simplified, 
c. Circulation will be dealt with as in If. above. 
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2. 



3t Periodical Sample 

a. Length of run will be eliminated from the data collection form. 

An additional tabulation form will be, provldGd for probability 
of ownership by Index* 

c. An additional samplG may be ^vawa from Keaders Guide to supple^ 
inoiit the main sample * 

4, Inside the Library Clrciilntlon 

a* Bate of Tnaterlals used has been eliminated from the data collec-^ 
tion form* 

b. Some libraries may want to monitor popular magaEines and news-* 
papers more frequently than once an hour, 

c. Point out In the Procedure Manual that it Is not necessary to 
reshelve marerials left to be counted each hQur^ merely remove 
them to book carts until they can conveniently be replaced* 



5, Outside the Library Circulation 

a. We might add further tabulations such as, average number of 
items borrowed per hourp average number of books borrowed per 
borrower p percent of users borrowing books, etc. 



6, Inter-Llbrary Loan Circulation 

k. This section will be removed for the time being* It will be 
completely revanped at a later date. 



7, User Characteristics 

a. Additional, primarily quicker, methods of tabulating the user 
tickets will be added t 

b. Tabulation tables will be better sequenced to facilitate the 
flow of tabulation, 

c. It will be suggested that the tickets be coded before any method 
of tabulation is usedt A code sheet will be provided. 

da Provision will be made on the tabulation forms for graduate, 
technical, and pre-school categorlei of users, 
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Provisioii will be made for Individuals who are employed but 
also liwolved in some kind of school work. 

More examples of the Qccupational categories will be pro- 
vided. 

Elimination of the question on ownership of a library card 
is being considered. In. cases where there is reciprocal bor^ 
rowing between libraries > the answer to this question Is am^ 
blgubuB therefore casting doubt on the data collected. 

No response and % columns will be , added to the tabulation 
forms where lacking * 

Sequential numbering of tickets before they are distributed 
may be suggested in order to determina the number of tickets 
that are not returned during the day Fionltored* 

Facilities and EquipTnent Availability and Usage 

a. The forms for recording availability and .usage of equipment 
and facilities will be sychronized so that all Items listed 
on one coincide with those listed on ^ the others* 

b. Additions should be inade to the list of equipment* 

Ci It might be suggested that spffie pieces of equipment should 
be monitored more frequeritlyi For examplep a log sheet 
might be more applicable for a photocopy machine. 



Staff Availability 

a. The data collection form will be modified In order to make 
the tabulation Instructions clearer, 

b. Small libraries may find this measure lijss useful if thaxa 
are only one or two staff members on duty at any one time, 

c. Instructions will be made more eKpllcit as to exactly who Is 
to be counted and who Is not. 



Patterns of Staff Assistance 

a. Definitions of types of questions will be made more rigorous , 

b. Directional questlona may be merely tallied by hour without 
adding any of the other Information asked for. 

c. Questions by phone should be Indicated separately and perhaps 
added to number of users for the day monitored * 
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University of Illinois at Urbana- Champaign 



LiBRARy RISiARCH CENTER * 220 ARMORY BUILDING ' CHAMPAIGN, lUlNOli 61820 • {2\7) 333^1980 



Dear 

The Library Research Center at the University of Illinois^ Urbana* 
under contract with the Illinois State Library * is conducting a 
project entitled "Measurement and Evaluation of Public Library 
Services" as part of the State Library's program of measurement 
and evaluation to assist library administrators at the local*, 
system and state level. ■ ^ 

The project complements and parallels the worlc of the Public Li-- 
brary Associations' Committee on Public Library Goals* Guidelines* 
and Standards* and the Illinois Library Association's Standards 
Committee. 

The long-range goal of the project is to make available meaningftil 
information to assist public library board meiTtoers* library 
administrators* government officials* and interested citizens in 
the evaluation of their public libraries. 

More specifically* the Library Research Center will (1) test the 
PLA performance measures developed by the Bureau of Library and 
Information Science Research at Rutgers University in a random 
sample of Illinois public libraries, (2) teach a sample of Illinois 
librarians and Illinois library system personnel the data collec- 
tion techniques necessary for testing the PLA performance measures* 
(3) analyze the information collected in order to determine the . 
relationship between the PLA performance measures* library- 
community characteristics* ILA standards* and professional judge- 
ment* and (4) prepare a final report detailing findings and 
presenting tentative norms to assist library administrators in 
interpreting the PLA measures. 

Your library has been selected as part of the random sample of 
Illinois putolic libraries. The libraries were drawn so as to 
guarantee a representative sample with respect to various size and 
budget factors. ^ Participating libraries will be required to (1) 
send a representative to a one-day workshop to learn the necessary 
data collection techniques* (2) train their staff to collect the 
appropriate performance measures data* and (3) allow the Library 
Research Center staff to collect data on each library* s charac- 
teristics. The data will then be tabulated and analyzed by the 
Research Center and mado available to Illinois Public Libraries in 
a final report. In addition, each participating library will be 
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given a profile of its scores on the measureinent criteria which 
show how each score related to those of other libraries of 
similar size. 

It is expected that the worTcshops will "be held in aaveral loca- 
tions in the state during the month of January 1975. The libraries 
will than collect the data for a three day period in the month of 
February, March, or April. The Research Center will issue the 
final report in the summer of 197S. 

Needless to say, your cooperation is critical to the success of 
this project, and we sincerely hope that you will be able to 
participate. If you have any questions, please write Dr. Lucille 
Wert at 220 Armory Building, University of Illinois, Urbana, 
Illinois, 61801, or call { 217) =333-1980 . 

« ■ . 

Sincerely* 
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APPENDIX D 



Notice of Workshops 
sent to Sample Libraries 



University of illinois at Urbana-Champaign 



UBRARY R'ESfARCH CENTER * 220 ARMORY BUILDING • CHAMPAIGN, lUINOlS 61820 ' {2)7) 333O9S0 



Dear Librarian: 

Enclosed plGase find, your copy of the inanual Performance Measures 
for Public Libraries hy Ernest R. DeProspo et al. One represent- 
tatlve of your library (e.g.. Library director , staff meniber, 
board of trustee memberf etc*) is invited to read the manual and 
attend one of the four regional workshops that will be held in th 
following locations across the state i 

Workshop location an d datei 

Withers Public Library 
202 East Washington Street 
Bloomington, Illinois 61701 

Monday^ March 10^ 1975 



Helen Matthes Library 
100 East Market Avenue 
Effingham, Illinois 62401 
Tuesday, March 11, 1975 

Rockford Public Library 
215 North Wyman Street 
Rockford, Illinois 61101 
Monday, March 17, 1975 

Wheaton P^lic Library 
225 North Cross 
Wheaton, Illinois 60187 
Monday, March 24, 1975 

(All workshops will be held from 9i30 a.m* to 4t00 p*m.) 

The sessions will teach the use of the manual to all public li- 
brary participants through realistic examples and actual practice 
of data collection. 



For me mbers oft 

Western Illinois Library System 
Illinois Valley Library System 
Rolling Prairie Library Gystem 
Great River Library System 
Lincoln Trail Library System 
Corn Belt Library System 
and Mattoon Public ^Library 

Lewis and Clark Library System 
Cumberland Trail Library System 
Kaskaskia Library System 

Northern Illinois Library System 
River Bend Library System 
Starved Rock Library System 

North Suburban Library System 
Suburban Library System 
Dupage Library System 



* 



8.1 



APPENDIX E' 

Notice of WorTcshop 

mnt to Systems HQadquarters 



8P 



FRir 



University of Illinois at Urbana-Champaign 



LIBRARY RESEARCH CENTER - 220 ARMORY BUIIDING - CHAMPAIGN, ILLINOIS 61120 - (217) 3330980 

February 21, 1975 



Dear '( 

Enclosed please find one copy of Perfor mance Measures for Publla 
Libraries by Ernest R. DeProspo et al.- This manual will be dis- 
cussed at a workshop to be held on Friday^ March 7 from 9^30 a.m. 
to 4: 00 p.m. at the Rolling Prairie Library Systems Headquarters^ 
345 West Eldorado Street^ Decatur^ Illinois. 

Representatives of your system are invited to the above-mentioned 
workshop* The main purpose of this session will be to teach the 
use of the manual to the participating system personnel tlirough 
realistic examples and actual practice of data collection. Par-- 
ticipants should read the manual prior to March 7th. 

We hope that your system will be able to send two staff members 
to the workshop. They will then be responsible for assisting 
those libraries in yo^^r system which participate in the perfor^ 
mance measures study. Their responsibilities will include super-- 
vising the participating public libraries in your system in the 
application of the performance measures and helping them to re- 
solve any problems encountered during the three--day survey period. 
Data collection problems may also be referx id to the Performance 
Measures staff at the Library Research Center. 

Please call the Library Research Center at (217) -333-1980 to in-- 
form us whether^ or not your system will be participating in the 
workshop and the names of the staff raemODers who will be attending. 

Thank you for your cooperation. 

Sincerely yours. 
Performance Measures 
Evaluation Staff 
Library Research Center 

Friday, March 7, 1975 
9:30 - 4:00 

Rolling Prairie Library System Headquarters 
Parking available 



APPENDIX F 



Questionnaire sent to 
Subsample of Participants 
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Uiiiversiiy of illinois at Urbana^Champaign 



LIBRARY RESEARCH CENTER * 220 ARMORY BUiLDiNG * CHAMPAIGN, jUlNOlS 61120 ' (21?) 333.1980 

June 16, 1975 



Dsar Librarians 

Thank you for participating in the study on Performance Measures 
for Public Libraries. In order to fully evaluate the parforinance 
maasuras manual and related activitiGS^ we believe that we need, 
feedback from librarians that actually conducted or assisted in\ 
the conduct of a library evaluation. Consequently, wa would 
greatly appreciate your completing the following questionnaire 
and returning it to the Library Research Center by June 25^ 
(Systems personnel should answer only those questions that relate 
to their experience w^ith the performance measures study*) 
Thank you. 

Library Research Center Staff 

1* Approximately how many staff hours were needed to prepare 

for the three-day performance measures study of your library? 



2* ApproKimately how many staff hours were needed to organize 

and tabulate the data collected during the three--day perfor- 
mance measures study? 

3, How many extra persons (e,g., volunteers, temporary employ- 
ees, etc.)/ if any, were needed by your library to complete 
the three-day study and tabulations? _______ 

4. In your opinion, is the performance measures manual 

sufficiently self-eKplanatory? 

s 

5* rniSit problems did you Wcounter in connection with the 
performance measures manual and/or the three-day study? 



I 



6, Which portions of the parformanca measures study do you 
expect to be the most hGliDful in the administration of 
your library? 



ERIC 



The least helpful? 



now helpful did you find the workshop on the use of the 
performance measures manual? (Rate on the following 
5-point scale) : 



I I L_ 

No Help Great Help 



Do you have any suggestions for changes in future work- 
shops on the performance measures manual (e.g*^ longer 
workshops* more explicit instructions)? 



What is your general opinion of the performance measures 
manual as a tool for assisting in the evaluation and 
improvement of your library? ' 
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Please telephone your system headquarters by March 4, 1975, to 

inform them that: (a) you. will participate in the study and the 
apiaropriate workshop, \h) you will participate in the study but 
will not be able to attend the workshop, oi: (c) you will not be 
able to participate in the study. Participants who cannot attend 
the workshop should contact their system headquarters and arrange- 
ments will be made to schedule separate training sessions. Please 
consult your system headquarters about travel expenses, etc. 



Thank you for your cooperation , 



Sincerely yours. 
Performance Measures 
Study Staff 

Library Research Center 



Note I 



The members of the Illinois Valley Library System and 
Mattoon Public Library will be contacted directly by mem= 
bers of the Library Research Canter's Performance Measure 
staff. 
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